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PREFACE 


There is a pronounced need of a book on advanced calculus that 
does not sacrifice rigor to such an extent as to become ineffectual 
as an instrument for developing a critical attitude toward analyti¬ 
cal processes, and yet which is sufficiently concrete to be useful 
to a student with one year of preparation in the calculus. I am 
under no delusion that this volume completely fills this need, 
and I shall feel generously repaid for my efforts if it should prove 
of some aid to those who are faced with the perplexing problem 
of instruction in analysis. 

In preparing this book I have made every effort to keep in 
mind the difficulties of the reader who is encountering for the 
first time a serious body of mathematical doctrine. Some ideas 
that are innately difficult, but whose basic sources stem from 
geometry, are presented first from an intuitive point of view, 
so that the essentials can be grasped at once. I did not think 
it wise to include rigorous arithmetical proofs of such theorems 
as those on convergence of bounded monotone sequences (Sec. 6), 
the theorem of Bolzano-Weierstrass (Sec. 7), the theorem of 
Darboux (Sec. 35), and a few others. This is in accordance with 
the precept that the most effective means of thwarting interest 
in mathematics is by misdirecting rigor. A reader who is suffi¬ 
ciently sophisticated to feel the need of arithmetical proofs of 
these theorems will find them in the treatises to which I refer 
in the text. The material contained in this volume is so arranged 
as to minimize the need of irksome references to matters to be 
established later on. No difficult and essential proofs have been 
relegated to exercises to be worked out at the reader’s leisure. 

The subject of advanced calculus is not an easy one, and the 
working of the problems is essential to a mastery. There are 
numerous illustrative exercises and problems scattered through¬ 
out the text to aid the reader in gaining an insight into the beauty 
and the wide range of applications of analysis. A student with 
a good background in the calculus will be able to read this book 
without omissions. 


V 
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PREFACE 


A considerable portion of the material included here represents 
a transcription of the lecture notes that I have used from time to 
time in my classes. These notes place me under some obligation 
to many of the existing books on analysis, especially to the 
masterpieces of Goursat, Knopp, and de la Vall6e Poussin. I 
am also much indebted to my wife, who not only undertook the 
arduous task of reading the manuscript in its various stages, but 
who also aided me immeasurably with the correction of the proof. 
Her assistance has resulted in many essential improvements. 

Ivan S. Sokolnikofp. 

Madison, Wis., 

Nwemher ^ 1939. 



CONTENTS 

Paoi 

Preface . v 

Chapter I 

SBcrioV^ LIMITS AND CONTIIjyiTY 

iM^u^ber System. 1 

2. ^S^uences. 3 

3\JElmiit of a Sequence. Convergence. 6 

4. Inequality of Bernoulli, lim V® “1. 8 

AJiXistence of the Limit.10 

Oy^p^terion for Convergence of Monotone Sequences.14 

^^^^vergent Sequences. Upper and Lower Limits.16 

^^^^^nctions of a Single Variable.22 

O^^JPBeorems on Limits.26 

10. '^e Base of the Natural Logarithms.28 

IL/Continuity.31 

l^^roperties of Continuous Functions.35 

13^J?fiiform Continuity.37 

Chapter II 

DERIVATIVES AND DlFPellENTIALS 

14.v-EJ^rivatives.41 

15|^^ififerentials.43 

16. Derivatives of Composite Functions.45 

17. Derivatives and Differentials of Higher Orders.47 

18. Fermat’s Theorem.49 

lO.vJWlle’s Theorem.50 

20. ^Mean-value Theorem.51 ^ 

21. Theorem of Cauchy. L'KospitaPs Rule.53 

7 

Chapter III 

^ FUNCTIONS OF SEVERAL VARIABLES 

2V^mits and Continuity. 58 

l{3{<Fartial Derivatives. 62 

24. Differentiation of Composite Functions.67 

25. Differentiation of Composite and Implicit Functions.71 

26. Euler’s Theorem.75 

27. Directional Derivatives.76 

28. Tangent Plane and Normal Line to a Surface.80 

29. Space Curves.83 

30. Directional Derivatives in Space.86 

- yy 




































CONTENTS 


viii 

SacnoN pAoa 

31. Partial Derivatives of Higher Order.87 

32. Higher Derivatives of Implicit Functions.89 

33. Change of Variables.91 

Chapter IV / ’ 

DEFINITE INTEG^^ 

3^, Riemann Integral.99 

35. '^liemann Integral— (Continued) .. . 104 

36. Direct Evaluation of Integrals.110 

37^^ean-value Theorems for Integrals.113 

38v^Fundamental Theorem of the Integral Calculus.118 

39. Differentiation under the Integral Sign.121 

40. Change of Variable.124 

41. Applications of Definite Integrals.126 

Chapter V 

MULTIPLE INTEGRALS 

42. Double Integrals.130 

43. Evaluation of the Double Integral.131 

44. Geometric Interpretation of the Double Integral.139 

45. Triple Integrals.142 

46. Change of Variables in a Double Integral.147 

47. Transformation of Points.153 

48. Change of Variables in a Triple Integral.155 

49. Spherical and Cylindrical Coordinates.157 

50. Surface Integrals.161 

51. Green’s Theorem in Space.167 

52. Symmetrical Form of Green’s Theorem.170 

Chapter VI 
LINE INTEGRALS 

53. Definition of Line Integral.174 

54. Area of a Closed Curve.178 

55. Green’s Theorem for the Plane.181 

56. Properties of Line Integrals.185 

57. Multiply Connected Regions. . ..192 

58. Line Integrals in Space.195 

59. Stokes’s Theorem.196 

60. Applications of Line Integrals. 199 

Chapter VII 
INFINITE SERIES V 

61. Infinite Series.209 

62. Series of Positive Terms.213 

63. More General Tests.225 

64. Series of Arbitrary Terms.233 

65ijAb8olute Convergence.236 

66. Properties of Absolutely Convergent Series.240 







































CONTENTS 


IX 


Bbction Paob 

67. Double Series.246 

68. Series of Functions. Uniform Convergence.247 

69. Geometric Interpretation of Uniform Convergence.252 

70. Properties of Uniformly Convergent Series.256 

71. Weierstrass Test for Uniform Convergence.262 

72. AbeFs Test for Uniform Convergence.264 

Chapter VIII 
POWER SERIES 

73. Power Series.267 

74. Interval of Convergence.269 

75. Properties of Functions Defined by Power Series.275 

76. AbeFs Theorem.276 

77. Uniqueness Theorem on Power Series.279 

78. Algebra of Power Series.280 

79. Calculations Involving Power Series. 285 

Chapter IX 

APPLICATIONS OF POWER SERIES 

80. Extended Law of the Mean. 291 

8L, ^ylor*s Formula.293 

82. y^aylor^s Series.296 

83. Applications of Taylor^s Formula.298 

84. Euler^s Formulas and Hyperbolic Functions.306 

85. Integration of Power Series.309 

86. /'Eyaluation of Definite Integrals.310 

S^Maxima and Minima of Functions of One Variable.315 

88. Taylor’s Formula for Functions of Several Variables.317 

89. Maxima and Minima of Functions of Several Variables.321 

9(^ Constrained Maxima and Minima.327 

91. Lagrange’s Multipliers.331 


Chapter X 

IMPROPER INTEGRALS 

92. Integral with Infinite Limit.335 

93. Tests for Convergence of Integrals with Infinite Limits.341 

94. Integrals in Which the Integrand Becomes Infinite.347 

95. Tests for Convergence of Integrals Whose Integrands Become 

Infinite.-.350 

96. Operations with Improper Integrals.352 

97. Evaluation of Improper Integrals.357 

98. Improper Multiple Integrals.365 

99. Gamma Functions.372 

Chapter XI 
FOURIER SERIES 

100. Criterion of Approximation.378 

101. Fourier Coefficients.380 






































X CONTENTS 

Sbctiok Paob 

102. Conditions of Dirichlet.385 

103. Orthogonal Functions.388 

104. Expansion of Functions in Fourier Series.390 

105. Sine and Cosine Series.397 

106. Extension of Interval of Expansion.401 

107. Complex Form of Fourier Series.403 

108. DifiFerentiation and Integration of Fourier Series.405 

109. Fourier Integral.409 

Chapter XII 
IMPLICIT FUNCTIONS 

110. A Simple Problem in Implicit Functions.415 

111. Generalization of the Simple Problem.418 

112. Functional Dependence.423 

113. Existence Theorem for Implicit Functions.425 

114. Existence Theorem for Simultaneous Equations.430 

115. Functional Dependence.433 

116. Properties of Jacobians.438 

Index .441 



















ADVANCED CALCULUS 


CHAPTER I 

LIMITS AND CONTINUITY 

1. Number System. This section consists of a brief summary 
of the concepts and propert ies of the system of numb ers that will 
be considered in this volume. The starting point is the system 
of positive integers. This system permits the operations of 
addition and multiplication but proves inadequate to permit 
the solution of many simple linear equations. Thus, if a, 6, 
c, and d are positive integers, a + a; = b and cy = d do not 
possess solutions that are positive integers unless b > a and d is 
an integral multiple of c. The first equation serves as the defini¬ 
tion of the new number zero if 6 = a and of the negative integers 
if b < a. The second equation demands the introduction of 

the fractional numbers — 
c 

The system of numbers consisting of the positive and negative 
integers and fractions and zero is called the system of rational 
numbers. It admits the four fundamental operations of addition, 
subtraction, multiplication, and division (except by zero). More¬ 
over, it is ^‘ordered,’' which means that if a and b are two different 
numbers, then a > b or b > a. Also, if c is a third rational 
number and a > b and b > c, then a > c. The system of 
rational numbers possesses the additional property of density, that 
is, between any two different rational numbers there is always 
another rational number (and, therefore, an infinite number of 
rational numbers) that is greater than one of the numbers and 
less than the other. 

A further extension of the number system is required when it 
becomes necessary to solve equations of the second and higher 
degrees. In elementary algebra a rational number is defined as 

one that can be expressed in the form y (b ^ 0), where a and b 
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are integers, and an irrational number is defined as one that does 
not possess this property. The irrational numbers include not 
only such numbers as \/2, -^4, -^3, etc., which arise in the 
solution of algebraic equations, but also t, 6, etc. The method of 
introducing the irrational numbers, which is outlined below, is due 
to Dedekind.* 

Assume that all the rational numbers have been separated into 
two sets in such a manner that every number in the first set is 
less than every number in the second set. A separation of this 
type is called a cut^ or partition^ (French, coupure; German, 
Schnitt) of the number system. Four cases present themselves, 
but it is easy to see that one of these is impossible. They are: 

i. The first set. A, contains a greatest element a and the second 
set. By contains a smallest element b. It cannot be that a = b 
since every element of A is less than every element of B. But 
if a < 6, then there are rational numbers which are greater than 
a and less than b (by the property of density). These numbers, 
being greater than a, must belong to B, and at the same time, 
being less than 6, must belong to A, which is impossible. 

ii. A contains a greatest element a, and B contains no smallest 
element. For example, let A consist of the number 2 and all 
rational numbers less than 2, whereas B consists of all rational 
numbers greater than 2. 

iii. B contains a smallest element b, and A contains no greatest 
element. For example, let B contain 2 and all rational numbers 
greater than 2, and A contain all rational numbers less than 2. 

iv. A contains no greatest element, and B contains no smallest 
element. For example, let A consist of all the negative rational 
numbers and all positive rational numbers whose square is less 
than 2, and let B consist of all the positive rational numbers whose 
square is greater than 2. Then the cut defines the irrational 
number \/2, In general, let the system of rational numbers be 
separated into two sets A and B in such a way that every number 
in A is less than every number in B and A contains no greatest 
dement and B contains no smallest element. Then the cut defines 
an irrational number that has the property of being greater than 
all the elements in A and less than all the elements in B. 

The system of numbers that includes all the rational numbers 
and all the irrational numbers is called the real number system. 

* Stetigkeit und irrationals Zahlen, Braunschweig, 1872. 
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The fundamental operations of addition and multiplication and 
the inverse operations of subtraction and division are defined for 
irrational numbers in such a way* that the system of real numbers 
possesses the commutative, associative, and distributive prop¬ 
erties. Moreover, if the product of any two real numbers is 
zero, then at least one of the numbers must be zero. 

It is often desirable to have a correspondence between the 
real numbers and the points of a straight line, so that analytic 
methods can be applied to geometry. In order to effect a one-to- 
one correspondence, it is necessary to assume the axiom of Cantor- 
Dedekind y which states that ^‘to each point on the line there 
corresponds one and only one real number and, conversely, to 
each real number there corresponds one and only one point on the 
line.’' 

As is already familiar from elementary algebra, the solution 
of the general quadratic equation ax^ + bx + c = Oy in the case 
where the discriminant — 4ac is negative, necessitates the 
introduction of a new type of number of the form u + iv, where u 
and V are real numbers and i is a number ^uch that = — 1, 
Such numbers are called complex nvmbers, iThe system of com¬ 
plex numbers includes the system of real numbers (as a special 
case when v = 0), and the fundamental operations must be 
defined so that they are consistent with those already in use for 
real numbers. This can be done by considering the complex 
numbers in the form u + iv or by treating them as ordered pairs 
(w, v) of real numbers. Since this volume deals primarily with 
real numbers, these definitions and the properties of complex 
numbers will not be discussed here.f 

2, Sequences. Let some ^process of construction yield a 
succession of real numbers 


Xi, xiy Xiy • • • , a;n, • • • , 

where it is assumed that every term x* is followed by other terms. 
A succession of numbers formed in this way is called a sequence 

* Db la Vall:£e Poussin, C. J., Cours d'analyse infinit^simale, vol. 1, 
pp. 1-8; Fine, H. B., College Algebra, pp. 39-55; Hobson, E. W., Theory of 
Functions of a Real Variable, vol. 1, pp. 20-34. 

tSee LA Valine Poussin, C. J., Cours d’analyse infinit^simale, 
vol. 1, pp. 37-42; Fine, H. B., College Algebra, pp. 70-78; Burkhardt, H., 
and Rasor, S. E., Theory of Functions of a Complex Variable, pp. 1-23. 
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and is denoted by the symbol {x*}. The individual terms of the 
sequence {xt} are called the elements of the sequence. 

Examples of sequences are 


(a) 1, 2, 3, 4, . . . 
(5) 1, -2, 3, ~4, . 

2 ' 4 ' 8 ' 16 ' 

(d) 0, 1, 0, 1, • • • 

{e) 2, 3, 5, 7, 11, . 


• • , (-l)’‘-% • 

• • • , ( — 

, HU + (-in • 

• •, p«, • • • • 


It is not essential that the general term of the sequence be given 
by some simple formula, as is the case in the first four examples 
above. \The sequence (e) represents the succession of prime num¬ 
bers, and^pn stands for the nth prime number. There is no 
formula available for the determination of the nth prime number, 
but it is possible to calculate all prime numbers less than any 
given number N. /Although the process of constructing the 

P;, ^ _ P, Pj 

- 4 - -+- 

Fio. 1. 


sequence (e) is much more complicated than the processes used 
for the other examples, nevertheless it yields a definite succession 
of numbers. 

It is convenient to represent the elements Xi of the sequence 
[xi] by points P< on a straight line. The points P» are so chosen 
that the distance from an arbitrary point 0 of the line to the 
point Pi is equal to x*. In this way a correspondence is estab¬ 
lished between the elements of the sequence and a set of 
points on a straight line. To avoid circumlocution, the elements 
Xi of the sequence will be called points^ instead of saying that they 
are numbers such that the distances of the points corresponding 
to them, from some fiducial point 0, are equal to Xi (Fig. 1). 

In studying j^^Vio-n^ r of sequences of real numbers^ or sets 
of points corresponding to them, several interesting cases present 
themselves. It may happen that one can find a positive number 
M such that the inequality 

IXnl ^ M 
or 

-Af ^Xn^ M 
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is satisfied for every n, however large. In such a case the 
sequence {a;»} is said to be hounded, A geometrical interpreta¬ 
tion of this circumstance is that the points Pi corresponding to the 
elements of the sequence always remain within a segment of 
length 2M with the point 0 as the midpoint of the segment. 

As an example, consider a succession of values 


12 3 4 
2 ' 3 ' 4 ' 5 ' 


• • ,(-i) 


n—1 


n 

nTl’ ■ ■ ■ ■ 


It is clear that, no matter how large n is taken, 


\Xn\ 


n 

n -f 1 


< 1, 


so that the sequence |( — ^ is bounded. 

The sequences (a), (6), and {e) (p. 4) are unbounded, but 
any number greater than or equal to 3^ will serve as a bound for 
the sequence (c), and any number greater than or equal to unity 
is a bound for (d). 

A sequence {a:»} is called a null sequence if subsequent to the choice 
of a positive number €, however small, one can find a positive integer p 
such that \xn\ < € for all values of n > p. 

If a graphical mode of representing the sequence by points 
on a straight line be adopted, the definition of the null sequence 
means that the points Pp+i, Pp+ 2 , . . . , corresponding to Xp+i, 
Xp+ 2 , . . . , will all lie within the interval of width 2e with the 
point 0 as midpoint. 

It is important to observe that the integer p in the foregoing 
definition is determined after the choice of the number c has been 
made, and hence, p depends on the magnitude of e. To clarify 

this, consider the sequence or 

ill 1 

V ' 2*' 32' ' ‘ ' n*' ’ * * ' 

This sequence is a null sequence, since one can always find an 
integer p such that for all values of n greater than p 
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or 


2 ^ 1 
n* > — 

€ 

Hence, if one chooses for p any positive integer greater than the 




number ^ -f the inequality will be satisfied. If e is chosen as 


MoOf aiiy integer greater than 10 will serve as p; but if € = 
p must be chosen greater than 100. 


PROBLEMS 

1. Show that -lil* is a null sequence. 

is a null sequence. Show that n must be 

chosen greater than logio^ in order that the inequality \zn\ < e be 
satisfied. 

3. Limit of a Sequence. Convergence. If is a given 
sequence and there exists a numberL such that the sequence {a;< — L} 
is a null sequence ^ then the given sequence is said to be convergent and 
the elements Xi of the sequence are said to approach the limit L, 
Recalling the definition of the null sequence, it is clear that if 
the limit of the sequence {a:*} is L, then corresponding to any 
positive number €, a positive integer p can be assigned such that 

\L — Xn\ < €, for all n > p. 

The last statement is frequently written in the following ways: 

lim Xn = L, 

n-* • 

or 

Xn-*L, 

when n—* 00 . The symbol n —» « is read “n tends to infinity.” 

It is clear that a null sequence is a convergent sequence with 
the value zero as the limit of the sequence. Moreover, it is obvi¬ 
ous that every convergent sequence is bounded.* 

* The converse of this statement is not true. Thus, the sequence 
0,1,0,1,0, . . . is bounded but not convergent. 


2. Prove that 
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The following theorem regarding null sequences is established 
easily: 

Theorem. If the terms of any null sequence 

X2, XZy • • • J Xny • • • 

are multiplied by a sequence of bounded factors 

Oi, 02, Os, • • • , On, • • • , 

then the resulting sequence 

aiar'H O2X2, a^Zzy • • • , On^Jn, • • • 
is a null sequence. 

Since the numbers On are bounded, there exists a positive num¬ 
ber My independent of n, such that 

(3-1) loni < M. 

Moreover, since the sequence {x<} is a null sequence, it is possible 
to find for every € > 0 a positive integer p such that 

(3-2) \z,\ < 

whenever n > p. Multiplying the inequalities (3-1) and (3-2) 
gives 

|OnXn| "M^ ~ 

which establishes the fact that the sequence {onXn} is a null 
sequence. 

Inasmuch as the notion of the limit of a sequence is one of the 
basic concepts of analysis, it is desirable to consider an example. 

Illustrative Example. Let the variable x assume a set of 
values 

xi = 0.3, X2 = 0.33, xz = 0.333, • • • . 

It will be shown that 

lim Xn = 

n—* «o 

that is, corresponding to an arbitrary 6 > 0, one can determine 
a positive integer p, such that the difference 
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\L - x,| = IM - »-| 

becomes and remains less than c for all values of n > p. 

Note that 

1 1 1 _ 1 1 1 
3 “ 30’ 3 300' ‘ ’ 3 ~ 3 • 10*' ‘ ' ‘ 

Now choose an e, and impose the demand that 

1 _ 1 
3 3 • 10“ *' 

But the inequality is equivalent to 

3 • 10“ > 

€ 

and taking logarithms to the base 10 of both sides of this inequality 
gives* 


log 3 + n > log 
or 

n > — (log € + log 3) == — log 3e. 

Thus, if p is chosen as any integer greater than |— log 3€l, the 
inequality will be satisfied for all values of n greater than this 
particular value of p. 

A geometrical interpretation of the statement 

lim Xn ^ L 

n—* «o 

is that all but a finite number of the points Xi will fall within 
the interval of width 2c about the point L, 

The totality of points whose distance from a given point L is 
less than a given number c is called a neighborhood of this point. 
The term vicinity is also used to denote the neighborhood. 

4« Inequality of Bernoulli, lim = 1. Let it be required 

to determine the limit of aan—* « by assuming the sequence 
of positive integral values and where a is any positive number. 

• It will be noted that if A > B, log A > log B, This fact follows directly 
from the definition of the logarithm. 
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This limit will be determined with the aid of an inequality estab¬ 
lished by James Bernoulli, which states that if x is any real num¬ 
ber such that 


then 


a: > — 1 and x 0, 
(1 + > 1 + nx, 


where n is any integer greater than unity. 

This inequality is obviously true if n = 2, since 

{1 + xY = I + 2x + x^ > I + 2x. 


The proof for any positive integral value of n will be established 
by the method of mathematical induction. Assume that the 
inequality is true for n = A:, and prove that then it is valid for 
n = A; + 1. Since the inequality is known to be true for n = 2, 
it will follow that it is true for n = 3, 4, 5, • • • . 

Assuming the truth of the inequality for n = Aj, that is, 

(1 + x)*' > 1 + kXf 

then 

(1 + x)*(l + x) > (1 + jfcx)(l + x) = 1 + (fc + l)x + jfcx* 

> 1 + (A? + l)x, 

and the proof is complete. 

To show that lim == 1 for a > 0, consider the two cases: 

n—> «o 

i. a ^ 1, 

ii. 0 < a < 1. 

i. If a = 1, the statement is obvious. 

If a > 1, > 1, so that one can write it as 

(4-1) = 1 -f- «». 

Hence, 

a = (1 -f x»)», 

and by the inequality of Bernoulli 

o = (1 -I- x»)" >1-1- nxn > nxn. 
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Consequently, 

n 

\ 

so that the numbers Xn form a null sequence, and it is seen from 
(4-1) that the sequence of numbers 

as n—> 00 . 

ii. If 0 < a < 1, then 1, and from (i) it follows that 
(«) - 1 } 

is a null sequence. If the terms of the sequence (4-2) are multi 
plied by the factors 

a, Va, v/ffl, • • • , \/o, • • • , 

there results the sequence 

{1 - ^ra}, 

whmh, by the theorem of Sec. 3, is a null sequence since the factors 
V^a are bounded.* 


PROBLEM 

Find the limits of the following sequences; 


/ X 1 2 3 
2’ 3’ 4’ 

rw 2 3 4 _ 
( 6 ) 1 * 2 ’ 3 ’ 

(c) 1, 2’ 4' • 


n — 1 


n + 1 

-, 

n 


» 2» ‘ 


V 2 ^2 ^2 

/ X 1 1 1 


1 

• • ■ mimrn 

1 

, • 

\/n 


6. Existence of the Limit. The definition of convergence of a 
sequence [xi] given in Sec. 3 implies the existence of the limit L, 

• The factors y/a are bounded since a ^ < 1. 
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since the application of the test, based on this definition, requires 
the knowledge of the limit L. 

The problem of the numerical calculation of the limit of any 
given sequence ordinarily is an exceedingly diflicult one, but in a 
great variety of practical and theoretical investigations one is 
satisfied with knowledge of the behavior of the sequence as 
to convergence and does not require the numerical value of the 
limit. There is a profound theorem due to A. Cauchy that 
enables one to establish the existence of the limit of a sequence 
without actually calculating the limit itself. This important 
theorem is as follows: 

■ The Fundamental Principle of Convergence. A necessary and 
sufficient condition for the existence of the limit of the sequence 
{aJn} is that for any e > 0 one can find a positive integer N such 
i Uhai for any pair of indices m and n, both greater than or equal 
to N, 

\Xin ^n| 

It will be established first that the condition enunciated in 
the principle is a necessary one. Let the sequence converge, and 
denote its limit by L. Then for any positive e, however small, 
one can find a positive integer N such that 

(5-1) \L - x„| < ^ 

whenever n N. But one can write 

Xm - Xn = (Xm - L) + (L — Xn) 

and, noting that the ^solute value of the sum is less than or at 
most equal to the sum of the absolute values, one has 

\Xm "”3/nl — £/| jL 

^ ® i" * 

^ 2 2 

where the last step results from the hypothesis (5-1). 

The demonstration of the sufficiency of the condition is not so 
easy. An analytical proof makes considerable demands on the 
mathemati(5al equipment of the reader,* but the correctness of 

♦ See Hobson, E. W., Theory of Functions of a Real Variable, vol. 1, p. 38. 
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the converse of the principle can be seen from the following 
geometrical considerations, which in essence do not depart from 
a rigorous analytical proof. 

The hypothesis this time is that for any € > 0, 

( 5 “ 2 ) \Xfn Xn\ ^ 

whenever m and n both exceed or are equal to Ny which, of 
course, depends on the magnitude of 6. Choose c = and 
denote the corresponding value of JV by iVi; then if pi is any, 
index greater than iVi, 

l^n Xp^\ <[ 

for every n > pi. 

Geometrically this means that all points Xn of the sequence 
for which n > pi lie within the segment of length unity which has 
Xp^ as its midpoint (Fig. 2). 



^Pi 

Fia. 2. 


If € is taken equal to 34; there will exist an integer p^ > pi, 
such that for every n > pz 

W - xpj < 

Then all points for n > pt, will lie within that portion of the 
segment of length with Xp, as the midpoint, which is contained 
in the segment of length unity. Setting e = one is assured 
of the existence of an integer pt > pi, such that 

1 *“ ~ 2 *’ 

whenever n > pt. That is, the inequality is satisfied for all 
points Xn that are contained in that portion of the interval of 
length with Xp, as the midpoint, which is common to the 
interval of length with x^ as the midpoint. 
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Continuing this process by assigning to e successively the 
values etc., one builds up a sequence of Intervals diminish¬ 
ing in length and such that the end points of these intervals tend 
to a definite point L, which is the limiting point of the sequence. 
Thus the existence of the limit L is demonstrated, provided the 
condition (5-2) is satisfied. 

The fundamental criterion of convergence is frequently 
stated in the following somewhat different, but equivalent, form, 
which the reader will have no difficulty in deducing. 

Theorem. A necessary and sufficient condition for the convert 
gence of the sequence 

* * * ) * * * 

is that for any 6 > 0, one can find a positive integer N such that 

\Xn^k — Xnl < « 

when n ^ Nf and for every positive integer k. 

It is seen from the foregoing that the significance of the criterion 
is, roughly, that all terms of the sequence for sufficiently large 
values of the indices lie arbitrarily near one another. 

In order to illustrate the application of the fundamental 
criterion, consider the sequence 

Hy • • • y 

where each term is the arithmetic mean of the two terms which 
immediately precede it. Thus the general formula for the nth 
term of the sequence (n > 2) is 

Xn-l + ^n-2 
Xn 2 

It is easily seen that the difference between two consecutive terms 
of the sequence is 

XfH-l 

But all the terms following Xn+i lie between Xn and and 
if any € > 0 has been assigned, one can choose a positive integer 
N so great that 
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With this choice of N the inequality 

|35m Xr\ t 

will surely be satisfied for any m and n that are not less than N. 
Thus, by the fundamental criterion, the sequence is convergent, 
f As an exercise the reader may attempt to show by induction 
that 

2 _ 1 1 
”3 3 

SO that the limit of this sequence is although one need not 
know the limit itself in order to establish the convergence of the 
sequence. 

6. Criterion for Convergence of Monotone Sequences. The 
fundamental criterion of convergence is applicable to any type 



Fio. 3. 

of sequence, but if one is dealing with monotone sequences (that 
is, such that either Xr,^i ^ Xn for all values of n or Xn^i ^ 
for all values of n), there is a simpler criterion that states that 
a monotone sequence which is hounded is convergent. 

In order to make this assertion plausible, assume the sequence 
{xn} to be monotone increasing and bounded, that is, 

Xn^l ^ Xn) 

and \xn\ < M for every value of n. Geometrically this means 
that the points corresponding to the elements Xn of the sequence 
move to the right writh increasing values of the index n (Fig. 3) 
but are always restricted to lie to the left of the point correspond¬ 
ing to the number M. It is thus intuitively clear that there must 
be some point L ^ M toward which the points Xn tend with 
increasing n. This point L is the limit of the sequence. 

The discussion in the preceding paragraph applies to the case 
of monotone decreasing sequences bounded on the left if the 
words right and left are interchanged. It should be remarked 
that the foregoing discussion is based on an intuitive notion as 
to what happens in a corresponding geometrical situation. A 
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rigorous analytical proof based on a refinement of this pictorial 
idea is omitted. 

To illustrate the use of this criterion of convergence of mono¬ 
tone sequences, consider the sequence where 


*1 = 

+ M, 


Xn - 


+ 


n -h 1 n + 2 


+ 


+ 4 ’ 


This sequence is monotone increasing since 

_ 1 1 ^ « 
2n + 1 2n + 2 ^ 

Moreover, it is bounded for 


_ 1 . 1 
n + I n + 2 


+ 




n-l- 1 


< 1 . 


Therefore, the sequence {xn} is convergent. 

The power of this criterion lies in the fact that it requires only 
the proof of monotonicity and of the boundedness of the sequence. 
Accordingly, it is much easier to apply than the more general 
fundamental criterion. 


PROBLEMS 


1. Show that the sequence 


,l+i + i + 


+r'’ 


is convergent. 

2. Prove the convergence of the following sequences: 
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<« {:p}' 

« 

7. Divergent Sequences. Upper and Lower Limits. Consider 
again a variable x that assumes a set of real values 

Xij X2, • • • j Xn, • • • 

and a set of points Pi, P 2 , • • • , Pn, • • • associated with it. 
If the sequence {xn} fails to converge, it is said to diverge. 

The sequence may fail to approach a limit because the variable 
X becomes infinite, which simply means that one can find a posi¬ 
tive integer N such that for every n ^ N 

\Xn\ > My 

where is a preassigned positive number, however large. In 
geometrical language, the statement that x becomes infinite 
means that no matter how large a segment with 0 as the midpoint 
one may take, there will be points Pn that lie outside this segment. 
If the variable x becomes infinite in such a way that after some 
value, say Xp, it remains positive, it is said to tend to positive 
infinity. On the other hand, if it becomes and remains negative 
after some Xp, it is said to become negatively infinite or to tend 
to negative infinity. 

For example, if x takes on the set of values 

- 1 , - 2 , - 3 , • • • , -n, • • • , 

it becomes negatively infinite. This behavior is commonly 
denoted by writing 

lim Xn = — 

n—► «o 

but this notation is bad since in this case the limit does not 
exist. It should be kept clearly in mind that the mark « is 
not a number but a symbol representing the idea that the variable 
X increases without limit. 

The variable x may also change in such a way that it neither 
approaches a limit nor becomes infinite. For example, if x 
assumes a sequence of values 

1 ““1 1 —I • • • 

^9 ^9 ^9 9 
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it is clearly bounded, but instead of approaching a limit, it 
oscillates between +1 and —1. 

In defining the limit L of a sequence it was stated that 
the inequality 

|L — Xn\ < € 

must be fulfilled for every value of n > p, regardless of how 
small the number € is chosen. A geometrical interpretation 
of this statement is that an infinite number of points P*-, cor¬ 
responding to the elements Xi of the sequence, lie in every interval 


-2 





- 

0 

Fio. 4. 


<•— 2(6 —> 

-1—I— I - 

/ ^/4 


of width 26 whose midpoint P corresponds to the limit L of the 
sequence. Accordingly, the point P may be called the point 
of condensation or the limiting point of the sequence {x*}. 

Points of condensation may arise even if the sequence {xf} 
is not convergent. For example, the sequence 


(7-1) 


« 3 4 5 6 

2 ' 3 ' 4 ' 5 ' 


, (- 1 ) 


n + 1 


n 


does not converge, but there are infinitely many elements of 
(7-1) in the vicinity of the points —1 and +1. Any interval of 
width 2€ (Fig. 4) about x = —1 orx = -f-l contains infinitely 
many terms of the given sequence, so that the points — 1 and +1 
are limiting points of the sequence (7-1). 

The points of condensation are of considerable importance 
in the study of the so-called power series* 

Definition of Limiting Point. A number L is called a limiting 
point of a sequence jx*} if for any € > 0 there is an infinite number 
of terms of the sequence satisfying the inequality 

\x„ - L| < €. 

The distinction between the definition of the limiting point 
and that of the limit is that, in the definition just given, the 
inequality 

l®n — I»1 < « 

•See Chap. VIIL 
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must be satisfied for any infinite number of terms of the sequence, 
whereas in the definition of the limit the same inequality must be 
fulfilled for every Xn whose index n exceeds some fixed positive 
integer p. Any number that occurs an infinite number of times 
in a sequence is obviously a limiting point. Thus, the sequence 

(7-2) 1, K, 1, K, 1, . . . 

has 1 and 0 as its limiting points, but the limit of this sequence 
obviously does not exist. 

A fundamental theorem concerning bounded sequences, due 
to B. Bolzano and K. Weierstrass, is stated as follows: 

Every bounded sequence possesses at least one limiting point. 
Moreover, it can be established that every bounded sequence 
has a least limiting point and a greatest limiting point.* This 
latter assertion is certainly obvious if the number of limiting 
points of the sequence is finite. 

Definitions of Upper and Lower Limits. The least limiting 
point of a bounded sequence {Xn} is called the lower limit and is 
denoted by the symbol 

lim Xn = L 

The greatest limiting point of a bounded sequence {xn} is called 
the upper limit and is designated by the symbol 

lim Xn = L. 

Recalling the definition of the limiting point, it is clear that 
if I is the lower limit of the sequence {x<}, then for any € > 0, 
there will be infinitely many terms of the sequence such that 

Xn < i + €, 

and at most a finite number of the Xn’s such that 

Xn < i — €. 

On the other hand, L is the upper limit of the sequence {xn} 
if there are infinitely many terms of the sequence such that 

Xn>L - 

* For a rigorous arithmetical proof of these assertions see £. W. Hobson, 
Theory of Functions of a Real Variable, Secs. 46-48. 
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and only a finite number (or none at all) such that 

Xn > 1/ + €. 


It follows from these statements that —1 is the lower limit of 
the sequence (7-1), while +1 is its upper limit. The lower 
and upper limits of the sequence (7-2) are 0 and 1, respectively. 

It is customary to extend the definitions of the upper and 
lower limits to unbounded sequences by saying that if there are 
infinitely many terms of the sequence {x*} whose magnitude 
exceeds any preassigned positive number Af, then the upper limit 
L is + 00 ; on the other hand, if the sequence {x^} is such that 
there are infinitely many terms Xn satisf 3 dng the inequality, 

Xn < —M, 

where M is any arbitrarily large positive number, then the lower 
limit Z is — 00 . 

For example, the sequence 

(а) 1, 2, 3, • • • 

has L = + > whereas the sequence 

(б) -1, -2, -3, • • • 
has Z = — eo. The sequence 




-1,2, -3,4, -5,6, • • • 


has L = + 00 and I = —<a. 

Some further examples of upper and lower limits of sequence 
may prove useful. The sequence 


(d) 




has L = 0 and 1 = 0, but the sequence 


+ 1 , - 1 , + 1 , - 1 , + 1 , • • • 

has Z = — 1 and L = 1. The sequence 

1, 2, H, 4, • • • , • • • 

has Z = 0, L = 00 , whereas 

,-l, -2, -H, -4, • • • , 
has Z = — 00 and L = 0. 


• • • 
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It will be observed that no definition of the lower limit was 
supplied for sequences of the type (a), whereas sequences of the 
type (6) lack a definition of the upper limit. It is desirable to 
fill these gaps so that one can say that every sequence has 
uniquely defined upper and lower limits. Accordingly, it is 
agreed that if the sequence {x*} is such that +oo is its only 
limiting point, then the lower limit I of such a sequence is also 
+ CO. On the other hand, if — oo is the only limiting point of 
the sequence, then both the upper and lower limits are defined 
to be — 00 . 

The sequence (d) is interesting because it has L == I = 0. 
There is a theorem in regard to bounded sequences whose upper 
and lower limits are equal. 

Theorem. A necessary and sufficient condition for the convert 
gence of a hounded sequ^e is that the upper limit L he equal to the 
lower limit 1. 

The proof of the theorem is not difficult. For, if 

A, 

then for any e > 0 there is at most a finite number of terms 
of jxn} such that 

Xn > + € = Vl 4“ €, 

and also at most a finite number of Xn for which 
a;n<Z-'€ = A— €. 


Thus, 


A — € < Xn < A + c, if n '> py 


or 

|xn - A| < €, if Py 

which is the statement that lim Xn = A. 

n-* 00 

Conversely, if 

lim Xn = Ay 

n —* 00 


then for any « > 0 and for n ^ p 
(7-3) \Xn- A\<€ 
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if 


or 


A— €<Xn<A+€. 

Therefore, 

(7-4) Xn < A + t 

for an infinite number of Xn, and the inequality 

Xn <. A — e 

is true for at most a finite number of the Xn. Thus 


(7-6) 1 = A. 

But (7-3) also states that 

Xn ^ A ” C 

is true for an infinite number of Xn, and that there are at most a 
finite number of x„ for which 

a:„ > 4 -h «. 


Consequently, 

(7-6) L = A. 

It follows from (7-5) and (7-6) that 

I = L. 

PROBLEMS 

1. Which of the following sequences diverge? 


(o) 0, 1, 0, 2, 0, 3, 0, 4, • • • 
ib) - ; 

ie) 1, -H, H.-H,- -; 

id) - ; 

,,, 3 7 2-+‘ - 1 

ie) 1, 


’ 2 » 

• • , log n, 


(/) log 1, log 2, 

f . _J_ 1_ . , 1 

^ log 2 ’ log 3 ’ ’ log fl 


(h) log log 


, log -> 
n 


2. Find the upper and lower limits for the sequences of Prob. 1. 
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8. Functions of a Single Variable. Let a pair of variables y 
and X be connected by some functional relation. The functional 
dependence of y upon x will be denoted by the symbol y = /(x), 
which means that to every value of x under consideration there 
corresponds at least one value of y. There is no implication in 
the foregoing statement that there is an analytical expression or a 
formula connecting y with x. In the study of elementary 
analysis one usually thinks of a function as being given by a 
formula indicating the result of performing some operations on x, 
such as x^, \/l — X, log x, sin 2x, etc. In the definition given 
h^ the term function has a much broader meaning. 

Wt will be assumed that the variable x is a real variable and that 
tne corresponding values of y are also real. The function 
y = /(^) is called a single^valued function if to every value of x 
under consideration there corresponds one and only one value of 
y. Otherwise, the function /(x) is called^t^fpZc valued^, Thus 
2 / = X* is a single-valued function, whereas y = sin”"^ x is a 
multiple-valued function of x. 

It is frequently necessary to restrict the range of values which 
X is permitted to assume. The function y — y/x furnishes 
real values for y only if x is restricted to be positive or zero. 
It is convenient to think of the values of x as being associated 
with the points of the x-axis of a cartesian system of coordinates, 
so that one can speak of the interval consisting of all real numbers 
between a pair of given values (say, x = a and x = 6). Such an 
interval is denoted by the symbol (a, 6), where a < b. If the end 
points of the interval (a, b) are excluded from consideration, the 
interval is said to be open, and the fact that x is not permitted to 
assume the values a and b is denoted by writing 

a < x <b. 

On the other hand, if the interval is closed, one writes 

a ^ x ^ b. 

The interval may be open at one end point and closed at the other. 
For example^ 

a ^ X < b 

means that the interval is closed on the left, so that the point 
X « a is included in the considerations, whereas x » b is excluded. 
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If for all values of a: in a given interval, f{x) is never greater 
than some fixed number Af, t ^e number M is called an upper 
pound for f(:r^ in tW. interval, wliereas if /(x) is never less than 
some number m, the latter is called a lo wer h ound.. One or both 
of these bounds may not exist. Thus y = sin a: in (0, 2ir) has 

an upper bound +1 and a lower bound —1, whereas y = - in 

a? 

the interval (0, 1) has a lower bound unity and no upper bound. 

The function y = - — a; has neither upper nor lower bound in the 
a? 

interval (0, oo). 

In considering the functional dependence of y upon x, it may 
happen that as x approaches, by any co nceivab le sequ jgnce of 
steps, the limit Xo, y also approaches a limit L, so that one can 
write 

(8-1) lim y = lim fix) = L 

3C—♦XO X—♦XO 

The precise meaning of this symbolic expression (8-1) is embodied 
in the following definition of the limit of/(x): 

The function /(x) approaches the limit L as x tends t(^XQ when, 
corresponding to any given positive number e, one can find a number 
d such that |/(x) — L| < € for all values of x for which 

0 < |x - Xo| < 5. 

It should be noted carefully that the statement 

0 < [x — xol < 6 

excludes the point x = xo from consideration, so that the numer¬ 
ical value of the difference must be less than c for all points in 
the interval (xo — 5, xo + 6), except at the point x = Xo. More¬ 
over, no restriction is imposed as to the way in which x is per¬ 
mitted to approach xo; so that the inequality 

\f{x) - Li < « 

must be satisfied whenever x —»*o through a set of values greater 
than or less than Xo. 

It may remarked that, since 

(8-1) lim /(x) = L 
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means \f{x) — L| < € for all values of x for which 
0 < I® — a;ol < 5, 
one can write (8-1) in an alternative form 
(8-2) fix) = L + r,, 

where \ri\ < e for all values of x such that 0 < [x — Xol < 5. 
The particular form (8-2) of the definition (8-1) will be of fre¬ 
quent use in the following pages. 

It is sometimes important to know the behavior of fix) when 
X —> xo in such a way that x always remains greater (or less) than 
Xq, that is, when x is allowed to approach xo from the right (or left) 
side only. In such cases it is convenient to adopt the following 
notation. If x —> Xo from the left (that is, x is always less than 
Xo), one writes 

X—>xo—, 

and the fact that x —»Xo from the right (so that x is always 
greater than xo) is denoted by 

X —> Xo“f"» 

These limits will be called the left-hand and the right-hand 
limits, respectively. 

Also 

lim/(x) = a or /(iCo—) = o, 

and 

lini/(x) — h or /(a:o+) = h, 

♦apo+ 

will stand for the left-hand and right-hand limits of fix). The 
symbols /(xo+) and /(xo—) should not be confused with the 
S 3 nnbol /(xo), which means the value of the function fix) calcu¬ 
lated at the point x = xo. In fact/(xo+) and/(xo—) may exist, 
whereas the function fix) may not be ^efined at x == Xo. To 

clarify this, consider an example. Let fix) =- - —j. It 

1 - 
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is readily established that 

lim/(a:) s/(0-) = 0, 

*-♦0 — 

and 

lim fix) = /(0+) = 1, 

while 

m = 

1 - 60 

which is utterly devoid of sense 
since division by zero is undefined 
(Fig. 5). 

Since another example may prove useful, let f{x) = 

In this case (see Fig. 6)/(I+) = «>,/(l —) = 0, but/(l) = 2^ is 
meaningless. 


Fio. 6. 

The function y = sin ^ has neither /(0+) nor /(O—), since 

sin i oscillates between its upper and lower bounds +1 and — 1 
as X —> 0 from either side (Fig. 6). 

PROBLEMS 

v/i. Find the right-hand and left-hand limits of f{x) =» x* as x 2. 
What is lim x*? 

^ Find/(0+) and/(0-) if/(x) = ■ What is lim/(x)? 

3. What are/(0+) and/(0 —) if/(x) « x sin -? Sketch the graph of 

X 

/(x) in the vicinity of x = 0. Find lim/(x). 

x -»0 
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X - 2 


4. Fmd/(2+) and/(2-), if/C*) = 

6. What is lim sin x7 sin 0"")^ 


6. Find lim -r^r- 

1 - el/* 

Sketch the graph of the function in the neighborhood of x = 0. 


9. Theorems on Limits. 

Theorem l.yThe limit of a sum is equal to the sum of the limits. 
If lim Li and lim / 2 (x) = L^, then 

x—^xo 


lim [f\{x) + fiix)] = Li + Lt. 

X —>*0 

The proof of this theorem follows directly from the definition 
of the limit. It is required to show that for any preassigned 
positive number c one can determine a number h such that 

+ fllix) — Li — L2I < €, 

whenever x lies in the interval 0 < jx — Xo| < 5. But, by 
hypothesis, lim/i(x) = Li, so that 

X—^Xft 


(9-1) |/i(x) — Li| < whenever 0 < |x — Xol < Bi- 

Similarly, 

(9-2) \fi{x) — L 2 I < whenever 0 < jx — Zo| < 52 - 

Now if 5 is chosen to be the smaller of 5i and 82 , thenlt follows 
from (9-1) and (9-2) that* 

\Mx) + Mx) - Li - L 2 I < g + ^ = «, 

whenever 0 < jx — Xo| < 5. 

* Since the sum of the absolute values is not less than the absolute value 
of the sum. 
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But this is precisely the statement that 

lim I/i(a:) + /s(x)] = Li + L,. 

The extension to a greater number of functions follows immedi¬ 
ately. 

^ Theorem 2. The limit of a product is equal to the product of the 
ytimits. 

If lim /i(x) == Li and lim f^ix) = L 2 , then 

X—»X 0 X—►xo 

(9-3) lim/i(x)/j(x) = LiL*. 

X—*X0 

It is required to show that 

|/i(x)/*(x) — LiLj] < t, whenever 0 < |x — xo| < 5. 
But 

\fi{x)h{x) - LM = |/i(x)/,(x) - -I- L,/,(x) - LM 

^ \fi{x)f^{x) - L,/,(x)| -I- |L^*(x) - LM 
!/*(*)! • \fiix) - Lxl 4- M • Ux) - M. 

By hypothesis lim / 2 (x) = La, so that fi{x) is surely bounded 

X—•xo 

in the neighborhood of the point x = Xo. Hence, l/ 2 (x)| < M 
for all values of x such that 0 < jx — xo| < 5'. Then 

\fi(x)Mx) - LiL,| < M • |/i(x) - L^\ + |Li| • \Mx) ~ L^l 

Moreover, since lim/i(x) = Li and lim/ 2 (x) = La, corresponding 

x-txo x—>x» 

to any € > 0, one can find a positive number 5 < 6' such that 

and ” 

!/*(*) - ill < 
whenever 0 < |x — a;o| < 5. Thus 

\fi(x)ft{x) — LiLjI < M. • + |Li| • =s c, 

whenever 0 < |x — Xo| < 3, which is equivalent to (9^). 
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The result can be immediately generalized to any number 
of functions. 

Theorem 3. The limit of a quotierd is equal to the quotient of the 
limits, provided the limit of the denominator is not zero. 

If lim fi{x) = Li and lim f^ix) = L 2 tA 0 , then it must be 

*—►*0 X -* X 9 

proved that 

UmiW.L, 

x-*xc f 2 i,x) Z/2 

Note that 

/>(*) r/.(x) _ Li], [■_/,(*) .Mx)] 

Mx) L,-lu L, 

But, since the limits of fi(x) and f 2 {x) exist and lim / 2 (x) 9 ^ 0, 

x—*xo 

one can certainly make the numerical value of each bracketed 
term of the right-hand member of the last expression less than 

when 0 < |x — Xo| < 6. Therefore, 

1 ^ - rj < 0 < 1* - ».i <«, 

which is the required result. 


PROBLEMS 

1. Give a careful justification of the inequality 

|/ 2 (x) - L 2 I • when 0 < jx - Xo| <5, 

used in the proof of Theorem 3. 

2. If n is a positive integer, prove that lim x" = 0, and, hence, that 

X—>0 

lim (oo + dix -h 02 X* + • • • + a»x») == oq. 

X -+0 


10 . The Base of the Natural Logarithms. An interesting 
application of the criterion for convergence of monotone 
sequences to the determination of the limiting value of the 


function 



as X—* CO , is contained in this section. 
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It will be shown first that 



approaches a limit when 


X tends to infinity by assuming positive integral values. In 
this case the problem reduces to the study of the behavior of 
the sequence {xn}, the nth term of which is given by the formula 



It will be shown that the sequence {x„} is monotone increasing, 
bounded, and hence convergent. 

Now the ratio of Xn to Xn-i is 



But by the inequality of Bernoulli,* for any n > 1, 


Hence, 



> 1 


n 

n* 



1 


Xn 

Xn—l 


> 1, 


SO that the sequence {xn} is monotone increasing, 
it is bounded on the right, since 


Moreover 




i\«+i 


/ 

and the sequence I ^ ^ J monotone decreasing, f 

* See Sec. 4. 
t See Prob. 2, p. 81, 
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and thus converges to some limit, which will be denoted 

by the letter e. Hence, 

( 10 - 1 ) 

Consider now the function 





where x is allowed to take on any sequence of positive real 
values tending to infinity. Let n be the greatest integer con¬ 
tained in any given value of x, so that 

n ^ X < n + 1. 

If X tends to infinity, the number n does likewise, and one can 
write 


aO-2) (l+;^y<(l+0’<(l + 0'" 

But it follows from (10-1) and from Sec. 9 that 
n-.« \ n + 1/ n->J , 1 


n + 1 


Also 


(‘ + 0 "*’ - [0 + 0"0 + 0 ] = 

Since the extreme members of the inequality (10-2) tend to 
the same limit, it follows that 
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The problem of computing a rational approximation to the 
number e with any desired degree of accuracy is discussed in 
Chap. IX. 

mOBLBMS 

1. Show, with the aid of the result (10-3), that 



Hint: Introduce the new variable f * — (1 + x) and let {tend to infinity 
through any set of positive values. 

2. Show that the sequence (yn), the nth term of which is 

is monotone decreasing and bounded. Forjn the sequence {^n — x*} 
where {a;„} is the sequence discussed in Sec. 10, and hence, deduce that 
lim yn = e. Show that 1 e < 3. 

Continuity. In defining the l imit o f f(x) as x-^Xq, no 
assumption was made regarding the value of the function at 
X = Xq. In fact, it was emphasized that the function need not 
be defined at x = xq. 

The function /(x) is said to he continuous at the point x = Xo, 
if the right-hand and left-hand limits of f(x) os x —» xo are equal 
and finite and coincide with the value of the function ai x = xq. 

This definition can be stated compactly in the form of an 
equation 

(11-1) v^1mi/(a:) =/(xo). 

x-*xo 

A more explicit way of restating the definition of continuity 
(11-1) is the following: 

If for any 'preassigned positive nuniber «, one can find a positive 
number S such that 

(11-2) l/(x) — /(xo)l < €, whenever \x — xol < S, 

then the function f(x) is continuous at the point x = Xo. 

^ A geometrical interpretation of the statement embodied in 
^(11-2) is immediate. Corresponding to any preassigned positive 
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number c, there can be determined an interval of width 26 about the 
point X = xo (Fig. 7) such that, for every x lying in the interval 
(xo — 8 , Xo + 8), fix) is confined to lie between /(xo) + « and 
/(xo) - €. 

An alternative way of writing the defining equation (11-1) 
is frequently useful. Thus (11-1) can be written in the form 

(11-3) fix) = /(xo) + ij, 

where lim = 0. The identity of (11-1) and (11-3) follows 

Z-*X0 

immediately upon taking the limit of both members of (11-3). 



Two important remarks are in order: 

а. If the function is continuous, then lim f{x) must exist, 

X—♦afo 

б. The function must be defined at the point of continuity. 

The significance of these remarks is made clear by the following 
examples: 

Illustrative Example 1. To test the continuity of f{x) = x* at 

X = 2, note that /(2) = 4. Moreover, lim x* = 4. Hence, 

*-♦2 

/(x) = X* is continuous at x = 2. 

X* — 9 

Illustrative Example 2. Let /(x) = —Now 

X — o 


/(3) = 


3* - 9 ^ 0 
3-3 0' 


X* — 9 

which is meaningless. But lim -= = lim (x -h 3) = 6. 

Hence, if fix) is defined to be equal to 6 at x = 3, then fix) will* 
be continuous at x = 3, but not otherwise. 
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sin X 

lUustraiive Example 3. Let /(x) =- if x 0, and let 

X 

sin X • • 

/(x) = 1 if X = 0. Now lim- = 1, which coincides with the 

as—>0 ^ 

definition of /(x) at x = 0, so that /(x) is continuous at x = 0. 

If it happens that the function /(x) is continuous at every 
point of the interval (a, fc), then the function is said to be con¬ 
tinuous over the interval (a, 6). If the interval is closed, the 
continuity at the end points x = a and x = 6 is defined by the 
equations 

lim /(x) = f(a) and lim /(x) = /(6), 

X—*0+ *—►b — 

since such a symbol as 

lim /(x) 

X—»a 

has no meaning if the consideration-of functional values is 
restricted to the closed interval (a, b). 

It is clear from the foregoing that any function that can be 
represented graphically as an unbroken curve is continuous. 
However, not every continuous function can be represented 
graphically. For example, let 

/(x) = X sin -f 

and consider the behavior of the function in the vicinity of x = 0. 
Inasmuch as sin ^ is defined at every point of the x-axis, except 
X = 0, one can calculate the values of /(x) for any sequence of 
values of x converging to zero. Moreover, since sin ~ is bounded, 

X 

lim X sin - = 0. 

x -*0 ® 

At the point x = 0, /(x) is undefined, but if it is agreed to assign 
the value zero to /(O), the function 

/(x) = X sin if X ^ 0, 

» 0, if X «= 0, 
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will be continuous at a: = 0; yet the graph of the function in 
the vicinity of the origin cannot be drawn, since the function 
oscillates infinitely often in any interval containing the origin 
(Fig. 8). 

Whenever a function fails to be continuous at a point, it is 
called discontiTmous at that point. The discontinuity at x = Xo 
is called infinite whenever f(x) becomes infinite as a: Xo- If 
the function is discontinuous at a point x = xo but is bounded 



in the vicinity of that point, the discontinuity is called finite 
or ordinary. If /(xo+) and/(xo—) exist and are unequal, their 
difference 

/(a:o+) - /(a:#-) 

is called the jump in the function. Thus the function 

fix) =- 

1 — e * 

discussed in Sec. 8 has a jump of one unit at x = 0, whereas 
1 

fix) = 2*“^ has an infinite discontinuity at x = 1. 

A function having a finite number of jumps in a given interval 
is called piece-wise amtinvms or sectionaUy coniinvms. 
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PROBUBM 

Discuas the continuity of the following functions: 
(o) y <= X* — 2x; 


(b) V 


2 *; 

1 


(c) y = e‘; 

(d) y = log x; 

(e) y = xsin^; 

(f) y = sin^; 


(?) V = 

(A) ? = 
(i) V = 


1 


(1 - *)” 
1 


1 


1 


- 3x + 2’ 


(i) y 


x + i; 

X 


(k) y = cot X] 

1 — cos X .. 

(l) y = -, if X 9^0, 

X 

= 0, if X = 0; 

(m) y = “f— if X 1, 


X - 1 
= 2, if X 


1 ; 


(n) y = c if X 0, 

= 0,ifx = 0; 

(o) y = 1 — X, if X > 0, 

= 1 4- X, if a? < 0, 
= 1, if X = 0. 


12. Properties of Continuous FunctioAs. It was seen from the 
discussion of /(x) = x sin ~ in Sec. 11 that the intuitive idea of a 

X 

continuous function as a function that can be represented 
graphically as an unbroken curve is quite inadequate to account 
for fimctions that are continuous according to the definition 
given above and that may not be capable of graphical representa¬ 
tion in the neighborhood of a point of continuity. A function 
that can be represented graphically as an unbroken curve is, of 
course, continuous. 

The seemingly simple concept of continuity becomes, on careful 
examination, exceedingly complex. A detailed study of the 
properties of continuous functions is the province of the theory 
of functions of a real variable, but some of the simpler theorems 
follow directly from the definition of a continuous function and 
upon the application of the theorems on limits. 

Theorem 1. The sum, difference, 'product, and quotient of any 
finite number of functions, each of which is continuous ai a given 
point X = Xo, wiU be continuous at x = xo, provided that the denom¬ 
inator of the quotient does not vanish cU x = Xo. 

The proof of this theorem follows immediately from the 
definition of continuity with the aid of the theorems of Sec. 9. 
It is left as an exercise for the reader. 
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Theorem 2. If y = fi{x) is a continuous function at the point 
X = xo, and if z ^ f 2 (y) is a continuous function at y j/o, where 
2/0 = fi{xo), then the composite function z = f 2 [fi{x)] is continuous 
ai X = Xo. 

By hypothesis z = f 2 (y) is continuous at y = j/o, so that 
lini/i!(y) =Myo). 

V-^Vo 

Hence, corresponding to any € > 0, one can find a positive 
number 6i such that 

1 / 2 ( 2 /) - f 2 (yo)\ < €, when \y - yo\ < 5i. 

But 

f2(y) = f2lfi(x)l 

and, therefore, the foregoing inequality can be written as 
(12-1) l/ 2 [/i(x)] ~/ 2 ( 2 /o )1 < €, when l/i(x) - yo\ < 5i. 

But fi(x) is also continuous at x = xo; hence, corresponding to 
the positive number 5i, one can find a positive number 5 such 
that 

\fi(x) — yo\ < 61 , whenever jx — Xoj < 6 . 

Thus (12-1) can be rewritten to read 

\f 2 lfi{x)] - 72 ( 2 / 0 ) I < €, whenever |x - Xo| < 5, 
which is another way of saying that 

lim/2[/i(x)] =72(2/0). 

X—^XO 

Th^ latter statement is precisely the definition of continuity, 
^v^heorem 3. If fix) is continuous at x = xo andfixo) 7 ^ 0, then 
one can find an interval about the point x = Xo such that fix) has 
the same sign as fixo) throughout this interval. 

The continuity of fix) at x = Xo means that corresponding to 
any € > 0 one can find a number 5 such that ^ 

(12-2) \fix) — fixo)\ < €, when [x — Xo| < 6. 

Now (12-2) can be written as 

(12-3) fixo) — € < fix) < 7(xo) + €, when jx — Xo| < 
and if € is chosen to be equal to |7(i*^o)l, the inequality (12-3) 
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reads 

(12-4) /(xo) - |/(*o)l <f(x) </(*o) + |/(a:o)l, 

when \x — Xi,\ < So. 

Hence, if f(xo) > 0, (12-4) becomes 

0 < f(x) < 2/(xo), 

so that /(x) is positive for all values of x in the interval 
iCo — 5o ^ ^0 H" ^0* 

On the other hand, if f(xo) < 0, then the inequality (12-4) shows 
that f{x) < 0 in the interval Xo — 5o < x < Xo + 5o. 

The reader might be inclined to regard the theorems just 
established as obvious from graphical considerations, which 
they indeed are if one restricts oneself to those continuous func¬ 
tions which can be represen^d by unbroken curves. 

13. Uniform Continuity, i In defining the c o ntinuity of a 
function at a point x = xo, it was stated that,^orresponding to 
an arbitrary positive number^one can find a positive number 8 
/depending on c) such that for all values of x in the interval of 
width 25, with Xo as the midpoint of the interval, the numerical 
value of the difference /(x) — /(xo) will be less than a/ 

It is important to observe that the magnitude of 5 depends on 
both the number^ and the value of xjunder consideration This 
can be made clear by considering the function/(x) whose^raph is 
shown in Fig. 9. Let € be prescribed; then for all values of x 
in the interval of width 25i about x = Xi 

|/(x) - /(Xj)l < «, 
whereas in order to make 


|/(x) - /(x*)! < t 


one would require the values of x in the neighborhood of the 
^int X = X 2 to lie in a much smaller interval of width 252. 
(Now the remarkable fact about functions continuous 

^ number 5 which is independent 
ofiiie'paflicular value of x under consideration and thus depends 
on € alone.* Or, to put it differently, if the interval (a, b) is 


• The proof of this is omitted. See E. W. Hobson, Theory of Functions 
of a Real Variable, p. 290; E. Goursat, Cours d'analyse math^matique, 
5th ed., vol. 1, p. 14; C. J. de la Vallee Poussin, Cours d’analyse infinitesi- 
male, vol. 1, p. 58. 
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divided in any manner whatever into a finite number of sub¬ 
intervals of widths not exceeding 26, then for any two points 
in the same subinterval, the numerical value of the difference 
between tEe values of f(x) will be less than 2^ To signify the 
fact that a single number 5 will serve for ail value s of ^ in th e 
interva l (a, h), one says that t he function is unifor mly continuous 
m the interval. J 

lit is not difflfcult to see that a function which is continuous 
imthe open interval (a, b) need not be uniformly continuous^ 



Thus, the function f{x) = - is continuous in the open interval 

X 

(0, 1), but it is not uniformly continuous there. The difficulty 

here arises because - becomes infinite as x —> 0. For any nonzero 

value of X the function is continuous, but it is impossible to 
subdivide the interval (0, 1) into a finite number of subintervals 
such that the numerical value of the difference of the functional 
values, for any pair of points in each of the partial interva ls, is 
less than a preassigned number c. 

The property of uniform continuity of functions defined over a 
closed interval is used in the following theorems.* 

* The proofs of Theorems 1 and 2 will be found in E. W. Hobson, Theory 
of Functions of a Real Variable, pp. 281-285; E. Goursat, Cours d’analyse 
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Theorem 1. A function f{x) continuous in a closed interval 
(fif b) is bounded in that interval. 

The theorem states that one can find a positive number M 
such that |/(a;)| ^ M, for all values of x in the interval a x ^ b. 

Theorem 2. If f(x) is continuous in a closed interval (a, 6), then 
there exists in this interval at least one value of xfor which f(x) takes 
its maximum value and at least one value of x for which it assumes 
its minimum value. 

theorem 3. If f{x) is continuous in a closed interval (a, b) then, 
as X takes all values between a and b, the function f(jx) takes at 
least once all values intermediate to f{a) and f(b). 

Corollary. If f (a) andf{b) are of opposite signs then there exists 
at least one point intermediate to a and b such that f(x) vanishes at 
that point. 

In order to give an idea of the type of reasoning employed 
in proving these theorems, the proof of Theorem 3 follows. The 
corollary to Theorem 3 will be established first. 

Let the signs of/(a) and/(6) be opposite and set H(a + 6) = Xi. 
If /(xi) vanishes, the corollary is demonstrated. If /(xi) 7^ 0, let 
(ai, 61) be that one of the two equal intervals (a, Xi) and (xi, b) 
for which /(ai) and /(61) are of opposite signs. Form 

X2 = J^(ai + bi). 

If /(X2) = 0, the corollary is established. If /(X2) 7^ 0 , let 
(a2, 62) be that one of the two equal intervals (ai, X2) and (x2, 61) 
for which f{a^ and fQ)^ are of opposite signs. If in continuing 
this process one does not obtain a number x< such that /(x<) = 0, 
there results a sequence of intervals 

(®ly ^l)> ^2); • • • ; bn), ’ * * > 

such that each of them is contained in the preceding, and such 
that the function /(x) has opposite signs at the end points of 
these intervals. 

The numbers a, ai, 02, •••, On, •• • form a monotone- 
increasing sequence and remain less than b, so that they tend to 
some limit* c contained between a and b. The numbers 6, 61, 
62, • • • , bn, • • • , on the other hand, are always greater than a 

math4matique, 5th ed., vol. 1, p. 16 (the English translation of this book 
contains these proofs on p. 143). 

♦See Sec. C 
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and form a decreasing sequence, so that they also converge to 
some limit c'. The limits c and e' are equal since the difference 

h» - o« = - a) 

tends to zero when n increases indefinitely. 

But /(x) is continuous in the interval (a, b), and therefore the 
difference 


f(bn) -/(an) 

approaches zero when n —» <». Moreover, since the signs of 
/(bn) and /(o„) are opposite, 

lim |/(6„) - /(an) I = 2|/(c)| = 0, 


or 


/(c) = 0. 

Thus the corollary to Theorem 3 is demonstrated. 

In order to establish the theorem itself, let k be some number 
between /(a) and f(b) and form the function 

F(x) =/(x) -fc. 

The function F(x) is continuous in the interval (a, b) and has 
opposite signs at the end points of the interval so that there 
exists at least one value c intermediate to a and b such that 
F(c) = 0. But, if F(c) = 0, 

/(c) = k, 

and the theorem is demonstrated. 

It may be remarked that if/(x) is steadily increasing or decreas¬ 
ing and is continuous in the closed interval (o, b), then there will 
be exactly one value of x, intermediate to a and b, for which/(x) 
assumes a prescribed value k, intermediate to/(a) and/(6). 



CHAPTER II 

DERIVATIVES AND DIFFERENTIALS 
14 . Derivatives.* 

Definition. If x = xa is any point of the interval (o, b) and if 
f(x) is a function of x defined over (a, 6), then 

lim + ^) - /(^o) 
h-*o h 

is called the derivative of f{x) at the point x = xo. 

Denoting the derivative of f{x) at x = Xo by the symbol/'(xo) 
and recalling the definition of the limit f give 

( 14 - 1 ) /(xo + ft) -fM ^ 

where 


lim 17 = 0. 

h —>0 


Rewriting ( 14 - 1 ) gives 

f(xo + h) — /(xo) = hf'ixo) hi)] 


hence, 

i/(xo + h) -/(xo)l ^ \hf'{xo)\ + M. 

Now if any « > 0 is prescribed, 

IV'(^o)| + IM 

can be made less than < by making h sufficiently small. Then, 
for any value of x in the interval xo — h < x < xo + h, 

\f(.x) -/(xo)l < «, 

* The reader is assumed to be familiar with calculations involving the use 
of the formulas for the differentiation of the so-called elementary functione. 
It is advisable to review them before proceeding with the study of this 
chapter, 
t See p. 24. 
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which states that f{x) is necessarily continuous at x == Xo if it 
possesses the derivative at x xo. This result can be stated as a 
theorem: 

Theorem. Any function having the derivative at a point is 
necessarily continuous at that point. 

The converse of the theorem is not true, as can be seen from 
the following example (Fig. 10): let 

/(x) = — X + 1 , when x > 0 , 

/(x) = X + 1 , when x ^ 0 . 


The function is obviously continuous at x = 0, but the derivative 
at X = 0 does not exist since the limit of the difference quotient 


/(x + A)-/(x) 
h 


independent of the mode of a pproach of A to zero^ does not exist. 
This becomes clear immediat 3 y TTohe recalls the geometrical 



Fiq. 10.—Graph of the function 
y = -z + 1. if z > 0; 

z + 1, if z ^ 0. 


interpretation of the derivative as the slope of the tangent line 
to the locus of /(x). If the point x = 0 is approached from the 
right, the slope of the tangent line is — 1, whereas it is equal to 
+1 when X —♦ 0 from the left. 

As a more interesting example consider the function 

/(x) = X sin if z 9^ 0 , 

X 

= 0, if a: = 0, 

which was shown* to be continuous at a: = 0 . However, the 
difference quotient is 
* See p. 33. 
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/(0 + ^) -/( O ) ^ 
h 



. 1 

sin T> 
h 


and lim sin t does not exist, since sin -r oscillates between +1 and 
A-+0 n n 

— 1 as A —> 0. 

To be sure, this function has a derivative at every point except 
a: = 0, but it is possible to construct functions that are continuous 
for all values of x in a given interval, but that do not have a 
derivative at a single point of the interval.* Functions that have 
derivatives are called differentiable functions, 

PROBLEMS 

1. Show from the definition that /'(I) = if f{x) = y/x, 

2. Does the derivative of 


m = 


exist at X = 1? 
3 . Let 


1 4. 

= 0 , 


Then 


fix) = x^ sin -1 

jC 

= 0, 


if 

if 


if 

if 


X 1, 
* = 1 , 


X ^ 0 , 
z = 0. 


/'(O) = 


u ^ /(0 + ^)-/( 0 ) 


lim 

A -^0 


sin 1 /k 
h 


= 0 . 


For any point other than x = 0 a formula for the differentiation of the 
product can be used Thus, 


fix) = 2 X sin i — cos 

X X 


which is meaningless at x = 0 . Why? 

16. Differentials. If the functional relation between y and x 
is given in the form 

y = f(x), 

* K. Weierstrass was the first to demonstrate the existence of such func¬ 
tions in 1861, Many examples of such functions have been constructed 
since then. 
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the variables y and x are called, respectively, dependerd and inde- 
penderU variables. 

Let Ax be an arbitrary increment in x. The resulting change 
in the dependent variable y when x changes by an amount Ax 
will be written as Ay. The increment of the independent variable 
X will be named the differential of x and denoted by either Ax or 
dx. The differential of the dependent variable y, on the other 
hand, is defined by the formula 

(16-1) dy = /'(x) dx. 


so that the differential dy and the increment Ay of the dependent 
variable, in general, are quite distinct. From the defining equa¬ 
tion (15-1) of the differential, it is clear that the derivative of 
y = /(x) can be expressed as the quotient of two differentials, 
namely. 


fix) = 


dx 


In this expression dx is assigned at pleasure, but dy is determined 
from (15-1). 

From the definition of the derivative 


it is seen that 


where 


Solving for Ay gives 


f{x) = lim 


Ay 

A®’ 


A® 


= /(*) + 


lim = 0. 

A *—»0 


Ay = /'(*) A® + If A® 


and, i^ce Lx ^ dx, 


Ay — dy = 1 ) Lx. 


For small values of Lx this difference is small. Geometrically 
If Lx represents the portion of the increment Ay cut off by ibe 
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tangent line to the locus of /(*) at the point where the derivative 
is computed (see Fig. 11). 

Example. Let y — xK Then dy = 2x dx, while 

Ay = (® + A®)* — X* = 2a: Ax + (Ax)*. 

In this case ij Ax = (Ax)*, so that ij = Ax. 

PROBLEMS 

1. Find dy and Ay, if ]/ = x*. 

2. Find dy and Ay, if y = \/x + 1, x i 0. 

3. Find dy and Ay, if y = sin x. 

16. Derivatives of Compo^t^Functions. If z = /(y) and 
y = ^(x), one can eliminate y Breween these relations and obtain 

2 = fM] ^ Fix). 

The function z = f’(x) may have a derivative but often it is 

ax 

undesirable to perform the elimination ol y in order to calculate 



If the functions/(y) and ^(x) are differentiable, it is possible 
dz 

to calculate ^ without performing the elimination. 

Note that if x is given an increment Ax, then y will acquire an 
increment Ay, and Ay —> 0 when Ax —> 0, since ^(x) is assumed to 
be a differentiable and, therefore, continuous function. But 
corresponding to an increment Ay there will be an increment Az. 
Thus one can write 
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lim ^ = lim ^ • lim 
or 

dzf & ^ \/ 

IS ^ dy dx 

In writing (16-1) it is tacitly assumed that Ay 5^ 0. There 
remains to be considered the case when Ay = 0 for some choice 
of the values of Ax approaching zero. Now 

A25 = /(y + Ay) ~ /(y), 

and if Ay = 0, then Az = 0, so that 

dz V Az ^ 
j- = lim 7— = 0* 

dx Ax*~^0 ^x 

Moreover, if Ay = 0 then 

dx Ax—»0 

Hence, the formula 

(16-2) dz^dz^d^ j 

^ * dx dy dx 

is true in this case also. 

As an illustration of this case, consider the function 

/2 


and 

Then 

and, for x = 0, 


z = 

w == X* sin if X 7 >^ 0, 

= 0, if X == 0. 

Az = 2u Aw -f (Aw)* 


Aw * (Ax)* sin ~ 
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111 1 

v 2ir Sir nir 

then Am = 0, and hence 

^0. 

\dx/x^o 


Moreover, 


dx 


Az 0 

lim — = lim — 

Ax—>0^^ Ax—>0^^ 


0 , 


and the formula (16-2) is valid. 

17. Derivatives and Differentials of Higher Orders. Inas¬ 
much as the derivative of y = f{x) is a function of x, it may be 
possible to differentiate again to produce arnew function, which is 
called the second derivative of fix). The customary notations for 

d^v 

the second derivative are /"(x) and The third derivative, 
that is, the derivative of the second derivative, is denoted by 
/'"(x) or and so on. 

The reason for the notation will be seen from the definition 

ax” 

of the differentials of higher order. The differential of y = /(a;), 


^ = /'(x) dx, 

is a function of x and dx, where dx is entirely arbitrary. Calculat¬ 
ing the differential of /'(x) and treating dx aa constant give the 
second differential 


= d[f'ix)] dx = /"(x) (dx)2. 


Similarly, 

d^^r{x)idx)\ 

and so forth. 

The formula for the differential of the nth order is 


d'^y = f^^'^ix) (dx)*, 


( 17 - 1 ) 
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so that one can write /‘"K®) as the quotient of two finite quan¬ 
tities, namely, 


/<■>(«) = g- 


This notation, however, is bad. For consider a composite func¬ 
tion z = f{y) where y = (p{x). From Sec. 16 it follows that 

dz = f{y) dy 

when y is a dependent variable. But calculating the differentials 
of higher order by the formula for the differential of the product 
gives 

(17-2) dPz = d{r(y) dy] = f{y) d(dy) + dy d[f{y)] 

% = f(y) d^y + r(y) {dy)\ 

which differs from the formula (17-1). 

If y is regarded as an independent variable, then dy must be 
considered as constant so that d^y = 0 and (17-2) agrees with 
(17-1), but the two results are quite distinct if y is not an inde¬ 
pendent variable. This is one of the reasons why the differentials 
of higher orders are seldom used.* 


PROBLEM 

Let y = /i(0 and x = /2(0 be such that the functional dependence of 
y upon X is given in a parametric form. It is known that 

dx fiit) 

Now 

cte* dx ycte J 

Applying the rule for the differentiation of quotients gives 
ox d^ _d^-dx- • dy 

-(S^i- 


On the other hand, using formula (17-1), 

dy^mdt, »//(0(*)*. 

dx^fliDdt, (Px^mt){dt)K 

* See also the problem on p. 48, 
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Substitute these expressions in the right-hand member of (17-3) and 
compare it with the expression for ^ obtained in the usual way. 

18. Fermat’s Theorem. The reader is doubtless familiar with 
some geometrical considerations that lead one to suspect that a 
differentiable function f(x) has a vanishing derivative at the 
points where f(x) attains its maximum or minimum values. In 
fact, these geometrical considerations form a basis for the discus¬ 



sion of the maxima and minima in the first course in calculus. 
An analytical proof of the theorem due to Fermat gives a rigorous 
justification for such considerations. 

Theorem. If a function f{x) assumes a maximum or a minimum 
value at an interior point { of the interval (a, 6), and if f{x) is dif^ 
ferentiable at x = then f {if) = 0. 

Let it be supposed that at the point x = { the function attains 
its maximum value. (The proof for the case of a minimum is 
entirely Analogous and is obtained by reversing the signs of 
inequality.) Remembering that x = {is an interior point of the 
interval and that/({) is a maximum, one has/(f + A) — /({) 0 

for positiv e or n egatTve h. 

^ ^ fU + h) ^/({) . 

h 


Form the differe n ce quotient 


(18-1) 


Since the numerator of (18-1) is negative or zero, 


(18-2) 

/(£ + *)-/({) ^0 

for A > 0, 

(18-3) 

o 

All 

1 

+ 

for A < 0. 


< 
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Taking the limit of (18-2) as A —> 0 from the right, there results 

m ^ 0 , 

while the limit of (18-3) as A —► 0 from the left is 

m) ^ 0 . 

But by hypothesis the derivative exists at a: = {, so that the left- 
hand and right-hand limits must be equal, which is possible only 
= 0 . 

jl9. Rolle’s Theorem. 

Theorem. If a function f(x) is continuous in the interval 
a ^ X ^ b and has a derivative at every int en gx^jpeint of (a, 6), and 
if the values of the function are equal at the end points of the interval^ 
then there exists at least one point x == {, (a < { < 6), such that 

||i Since f(x) is continuous in the closed interval (a, &), it attains 
Ip maximum value M and its minimum value m in (a, b) 
](Theorem 2, Sec. 13). If it happens that m = Af, then it follows 
that 

f(x) == const. = m. 

But the derivative of^he constant is zero so that the theorem is 
true in this case. / 


yjc^/ 




Next, assume that m < M. By hypotheg5/(a) = f{b) so that 
I at least one of the values m or Af is differenTfrom the value of the 
S function at the end points. Let it be Af. Then the maximum 
value Af is attained, not at the end points of (a, b), but at some 
interior point and it follows from Fermat’s theorem that 

m - ik 

It is important to observe that if the coi tion of the existence 
of the derivative is not fulfilled at a singlemterior point of (a, 6), 
the theorem may not be valid. This can be seen from Fig. 13. 
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SSO 

In neither of the examples in Fig. 13 does the derivative exist at 

aj = 0. 

If /(a) = f(b) = 0, Rolle’s theorem can be stated as follows: 
If a and b are two roots of the equation f(x) = 0, then fix) — 0 
has at least one root between a and b, provided that /(x) is continuous 
in the interval a ^ x ^ b and has a derivative at every interior point 
of fa, b). 

V20. Mean-value Theorem. 

Theorem. If a function f(x) is continuous in the interval 
a ^ X ^ b and possesses a derivative at every interior point of (a, 6), 
then there exists a point ( siLch that 

( 20 - 1 ) = /'(£). 


If f{a) = /(6), the theorem is a special case of Rollers theorem. 
Assume /(a) /(6), and construct a function 


F{x) = kx + /^) 


where the constant k will be so determined that F{x) satisfies the 
conditions of Rollers theorem, namely, 


F(a) = F(6), u/ 


or 

ka+fia) = kb+f{h). 

Solving for k gives 

b — a 


With this choice of fc, the function F(x) satisfies the conditions of 
Rolle’s theorem. Hence, there exists a point x = f such that 


F\o = k +m = 0 . 


Then 


and the theorem is established. 

A geometrical interpretation of this theorem is interesting. 
The expression 
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/(b) -/(g) 

b — a 

is equal to the slope of the secant line joining the points A and B 
on the locus of f(x) (Fig. 14). 

The mean-value theorem asserts that there exists a point P 
^n the locus of f{x) such that the tangent line at this point is 

parallel to the secant line AB. 

The mean-value theorem 
(20-1) can be written as 

(20-2) /(b)-/(a)- 

m(b - a), 

which gives the magnitude of 
the increment /(b) —/(a). 
For this reason the form (20-2) 
of the mean-value theorem is 
frequently called the formula of finite inc rements. 

Noting that {is an interior point of (a, b) and setting 



Fio. 14. 


f - fl 
b — a 


where 


0 < ^ < 1 , 


one can write 


{ = a + ^(b - a). 

Substituting this expression for { in (20-2) gives 
(20-3) /(b) - /(a) = (b - a)/'[a + e(}> - a)]. 

If the length of the interval (a, b) is denoted by A, 

b = a -b A 

so that the expression (20-3) can be written in the following useful 
form: 

(20-4) /(a + A) - /(a) = */'(« + 

where 0 < ^ < 1. 

An important theorem follows immediately from the mean- 
value theorem. 

TheorenL If a function hoe a derivative that vaniehee for all 
valuee of x in the interval a ^ x ^ hi the function is a constant. 
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Moreoverj if two functions have derivatives thai are equal for all 
values of z in (a, 6), then the functions differ by a constant. 

Let X be any point of the interval (o, b), and assume that 
f'(z) s 0 in (a, b). It follows from (20-2) that 

/(®) - /(«) = /'(€)(* - a) = 0. 

Hence, 

f(x) = /(o), 

which is constant. 

If /i(*) fi{x) are two functions with equal derivatives in 
(o, h), then 

Fix) ^Mx) -Mx) 


has a zero derivative in (a, 6). Therefore, 


and 


Fix) = const., 


/i(®) = /*(*) + const. 


21. Theorem of Cauchy. L’Hospital’s Rtile. 

Theorem. If fix) and <pix) are coniinuous in the interval 
a ^ X ^ b and have derivatives at each interior -point of (o, b), 
then 


m -fja) _ m 

„(5) - v>ia) ~ v'iO’ 


(o < f < V), 


provided that 

i- /^(®) <p'i^) not vanish simultaneously in (o, b); 

ii. <pif>) tpia). 

Note that the function 


Fix) ^fix)Wib) - via)] - vix)\fib) -fia)i 

satisfies the conditions of Rolle's theorem^ since F(o) = Fib). 
Hence, 

(21-1) fiMb) - #.(a)] - v'mib) - fia)] = 0, 
where ia < b). 

Since f'ix) and v'ix) cannot vanish for the same value of x, and 
once vib) «>(a), it follows that ^'(() cannot vanish. CSonse- 
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quently, one can divide (21-1) by ^'({)[^(6) — <p{a)\ to obtain 
the desired formula 


(21-2) 


m -m _ /(I). 

vib) — via) v'ik) 


(a<(< b). 


If v>'(®) is assumed to be different from zero at every interior 
point of the interval (a, b), then the conditions (i) and (ii) of the 
theorem are satisfied automatically. The condition (i) is obvi¬ 
ously satisfied since v'i^) ^ the fact that vib) — via) 0 

follows directly from the mean-value theorem. 

It is interesting to observe that (21-2) contains, as a special 
case, the mean-value theorem, for, setting ^(x) = x gives 

m - fia) = mib - a). 

It is readily shown that (21-2) can be written in the form 

fja + h) -fja) _ fia + 0h) ^ m ^ ^ n 

via + h) - via) ~ v'ia + 6h) ^ ^ i;. 

An important use of formula (21-2) is in the evaluation of inde¬ 
terminate forms. Thus, if /(a) = via) = 0, and if the theorem 
be applied to the interval (a, x), there results 

(.<{<.), 

vix) viO 

From this equation the following rule is obtained; 

fix) 

Rule. If fia) = via) = 0, and if the ratio approaches a 

limit as x—* a, then approaches the same limit. This rule for 

evaluating indeterminate forms is due to L’Hospital. By way of 
illustration consider the calculation of 

,. 1 — cos X 

lim-5- 

»-K) X* 

Now (1 — cos x)e_o •= (®*)»-o = 0, and one can apply the rule of 
L’Hospital provided that 


(a < I < x). 


exists. But this again is an indeterminate form since 
(sin x)^ - (2x)»rf »= 0. 
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exists since 


Hence, 


OllX JL 

“97" 


1 — cos X 


The rule of L’Hospital can also be applied to indeterminate 


forms of the type 


The proof is direct. Let lim /(x) = «> 


and lim ip{x) = <», and assume that f{x) and fp{x) have non- 

x—*a 

vanishing derivatives in the interval a < q? < Xo. 

Applying the formula of Cauchy to the interval (x, Xo) gives 


m - Six,) ^ 

<f>(x) — ^(* 0 ) <p'{0 


{x < ^< Xo). 


fix) - /(xo) ^ 
vix) - <pixo) vix) 


(21-3) 


<pixo) 

fixo) <p'iO 


Assume that 


lim = L. 

x-^a fp W 


This means that one can choose xo so near a that for all values of 
X between q and xo 

f'jx) _ 7, < , 
v'ix) ^ ^ 
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Having chosen xo to satisfy this inequality, let x —> a; then the 
first factor in the right-hand member of (21-3) can be made as 
near unity as desired. Hence, the left-hand member of (21-3) can 
be made to differ from L by as little as desired. This is another 
way of saying that 

Um = L. 

x-*a <P\^) 

The foregoing proof is easily modified to apply when a = oo. 

Example 1. 


lim X log X = lim ~ = lim = 0. 

*—♦0*1“ X —>04* * X —>0+ A 


Example 2. Evaluate lim 


X — sin X 


Applying the rule of L’Hospital gives 


X — sin X 1 — cos X 

lim- = lim- - -; 

Jt—♦ go X *-*♦ *0 A 


which does not approach a limit since cos x oscillates as x oo. 


X — sm X 


= Km (l ~ ) = 1 

X—* W \ ® / 


sin X 1 
X ^ \x\ 


0, as 


Note that this does not constitute a contradiction since the 
theorem asserts that if the quotient of the derivatives approaches a 
limit, then the quotient of the functions has the same limit. 


PROBLEMS 


1. Show that 


(a) lim — 0. if n > 0; 

(b) lim —■> 


0, if n > 1; 
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(c) lim = 0, if n > 0; 

> 00 

(d) lim X* = 1. Hint: Evaluate lim log x*; 

*—♦0+ as—♦04* 




2. Find 

(а) lim a;" log x; 

X —► 00 

(б) lim x^e-"] 

X —> 00 

sin X 


(c) lim 


0 


id) lim 


, X — sin X 

(e) lim 
*-♦0 

3. Show that 


lim ( - — cot xY 
\x ) 



CHAPTER III 

FUNCTIONS OF SEVERAL VARIABLES 


22. Limits and Continuity. Let u = f{Xj y) be a real, single¬ 
valued function of two independent variables x and y. One 
can think of the pair of values a: = rco and y = 2/0 as representing 
a point in the xy-plane, so that u = fix, y) at (xo, yo) becomes a 
function of the point. 

The function /(x, y) may be determined for every point of 
the xy-plane, or the totality of admissible points may occupy 
a certain region R in the xy-plane. Thus, if the attention is 
confined to real values only, the function 

u = \/l — X* — 

is defined for those values of x and y for which 

x^ y^ ^ 1 . 

The region B in this case is a circle of radius unity whose center 
is at the origin of the xy-plane. If the totality of points making 
up the region R includes the boundary of the region, then R 
is said to be closed. The function 

1 

U = - ■ V.:- 

Vl - x* — y* 

is defined in the open region x^ + y^ < 1. 

The definition of continuity of a function of two independent 
variables is a generalization of the definition of continuity of a 
function of a single variable. Let /(x, y) be defined at the point 
(xo, Vo) and in a sufficiently small region about this point. If 

(22-1) lim fix, y) = /{xo, y»), 

X—►X* 

y-*V9 

the function/(x, y) is said to be continuous at the point (xo, yo)> 
The precise arithmetical meaning of the statement embodied in 
C22-1) is the following: 
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If for any predesigned positive number € one can find a positive 
number 6 such that 

!/(*, y) - fixo, yo)l < «, 
whenever \x — Xol < 5 and \y — yol < 5, then the function is 
\pontinuous. 

Geometrically this means (Fig. 15) that one can find a square 
about the point (xo, yo) so small that the difference between the 


preassigned number €. 

Inasmuch as nothin] 
in the definition (22-1 
the manner in which x - 
y yo, the limit must 


► xq anc 


y‘ 

yo*^ 

yo 

1 




*(x,y) 

_ V ) 

j_^ 


1 

1 

1 


r T 

j_1_ 

'! 

Xo Xo*6 


Fio. 16. 


(a:o, yo). 

A function that is continuous 
at every point of a region R is said to be continuous in the region 
R. If the region is closed, the function is continuous in the 
closed region. For example, w = \/l — — 2 /^ is continuous 

wj^n and upon the boundary of the region bounded by the circle 
+ y^ = ir^ 

Only real functions of real variables x and y are considered 
in this chapter. There are theorems regarding such functions 
that are entirely analogous to those given in Chap. I for functions 
of a single variable. The more important of these are the 
following:* 

Theorem L / ///(x, y) is continuous at (xo, yo) andf(xo, yo) 0, 
then one can find a region about the point (xo, yo) such that /(x, y) 
has the same sign ae /(xo, yo) thrcughout the region. 

Theorem 2./A function /(x, y) that is continuous in a closed 
region is bounagd. in that region. 

Theorem ^*/If /(x, y) is continuous in a closed region^ then 
there exists ii/this region at least one point (x, y) at which /(x, y) 


* The reai^ing used in establishing the validity of these theorems is of 
the same character as that employed in proving the corresponding theorems 
for functions of a single variable. 
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takes its maximum value and at least one point where it assumes its 
minimum value. 

Tbwxem 4. If u and v are continuous functions of x and y, and 
if z IS a continuous function of u and r, then z is a continuous 
function of x and y. 

The definition of uniform continuity of a function of two 
variables is as follows: 

If for any preassigned positive number e, one can find a positive 
number 5, the same for the entire region R, such that 

yi) - f(.X2, 2/2)1 < e, 

for every pair of values {xi, yi) and (x 2 , 2/2) lhat satisfy the inequali¬ 
ties \xi — a:2| < 5 and \yi — 2/2I < 5, then /(x, y) is uniformly 
continuous in R. 

A function of two variables that is continuous in a closed 
region R can be shown to be uniformly continuous in R. 

The extension of these definitions to functions of more than 
two variables is immediately obvious. If 

“ = /(a;, y, z), 

the triplets of values (x, y, z) can be associated with the points 
of three-dimensional space. The square region |x — Xo| < 5 and 
\y — 2 /o| < 5 used in the definition of continuity of /(x, y) must 
be replaced by a cubical region defined by the inequalities 

|x - Xol <5, \y — 2/0I <5, \z — zo\ < b. 

If the function u depends on more than three independent 
variables, the usual geometrical interpretation of the independent 
variables as the coordinates of points in ordinary space fails, 
but the geometrical language may still be used. Thus 
u = /(xi, X2, Xs, X4), where Xi, X2, xa, and X4 are four independent 
variables, may be thought of as defined over a four-dimensional 
manifold, and the quadruplets of numbers (xi, X2, Xa, X4) may be 
associated with the points of a hyperspace. 

A continuous function u = /(x, y) of two independent variables 
X and y is a continuous function of each of the variables taken 
separately. Thus, if the value of one of the variables is fixed 
by setting y = yo, the resulting function of the single variable x, 
namely, 


« = /(*, yo), 



m 


FUNCTIONS OF SEVERAL VARIABLES 


61 


is obviously continuous in x. The converse of this statement 
may not be true, however. For example, let 


fix, y) = 


unless x = 0 and y = 0 simultaneously, 
0, if X = 0 and y = 0. 


Then for any fixed value of y (or x) the resulting function of a 
single variable is easily shown to be continuous. However, 
y) is not a continuous function of the two variables x and y 
at X = 0 and y = 0. To show this, it will suffice to demonstrate 
that there exists one mode of approach toward the origin for 
which lim /(x, y) 9 ^ 0. Let the point (x, y) approach (0, 0) 
along the line y = x. Then 


lim 

*—►0 

l /-»0 


2xy 


+ 


2a:* 

lim K-j 

2a:* 


= 1, 


whereas f(x, y) is defined to be zero at the origin. 

A word of caution is in order in regard to the meaning of the 
symbols; 

(o) lim fix, y), 

X — >X0 

y—*vo 

(6) lim lim/(x, y), 

x-*xo y—^yo 

and 

(c) lim lim/(x, y). 

y—>yo X—►xo 

The limits in (b) and (c) are called the repeated or iterated limits^ 
and the order of the two separate limiting processes in (6) and (c) 
cannot be interchanged in general. Thus, consider 



while 
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The limit in (a), on the other hand, must exist for any con¬ 
ceivable mode of approach of {x, y) to (xo, yo)- Hence, if the 
limit in (a) exists, the corresponding limits in (6) and (c) will 
exist and will be equal if the inner limits exist. The converse, 
however, is not true. The repeated limits (6) and (c) may exist 
and be equal, and yet the limit in (o) may fail to exist.* 

PROBLEM 

Show that f(x, y) = - Vo . / -^ is a continuous function in each 

icV + (x — yY 

of the variables taken separately but is not a continuous function of both 
variables at (0, 0). 

23. Partial Derivatives. Let u = /(a:, y) be a single-valued 
function of the independent variables x and y, and let it be defined 
at some point (xo, t/o) and for all values of (x, y) in some regionf 
R about the point (xo, t/o). If y is set equal to i/o, u becomes a 
function of the single variable x, namely, 

« = /(a:, 2/o). 

If this function has a derivative with respect to the variable x, 
the derivative is called the partial derivative of /(x, y) with 
respect to x, for y = yo. In like manner, if x is assigned a con¬ 
stant value Xo, the derivative with respect to y of the resulting 
function /(xo, y) is called the partial aerivative of /(x, y) with 
respect to y, for x = Xo. The customary notations for the partial 
derivative of w = /(x, y) with respect to x are: 

W*, fs{x, y), and 

The partial derivatives of a function /(xi, X 2 , • • • , Xn), of 
n independent variables, are obtained by fixing the values of 
n — 1 of the variables and calculating the derivative of the 
resulting function of a single variable. Thus, 

/(x, y, z) = yx^ — 2yx + xz^ 

* See in this connection Hobson, E. W., Theory of Functions of a Real 
Variable, p. 408. 

t ^alogous to the definition of the neighborhood” or ^vicinity” of a 
point given in Sec. 3 for a function of a single variable, the totality of all 
points whose distance from a given point P is less than a given number 
i > 0 is called a neighborhood of the point P, 
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has the partial derivatives 


dx 


2xy — 2y + 2 *, 


By 

V 

Bz 


X* — 2x, 
2X2. 


Recalling the definition of the derivative of a function of a 
single variable, one can see that the expressions 

^ = lim /(a:o + h, yo) - /(xp, yo) 

dx A->0 ^ 

and 

-- = lim yo + ^) ~ f(^0’ yo) , 

A-,0 k 

define the partial derivatives of f(x, y) at the point (xo, yo)- 

du 

Even though the notation — suggests a fraction, it must be 

ox 

noted carefully that it is merely a symbol for the partial deriva¬ 
tive, which does not find a sensible interpretation as a quotient 
analogous to that given for the ordinary derivative. 

Let Au denote the change in the value of = /(x, y) when x 
and y acquire, respectively, the increments Ax and Ay, Then 

(23-1) Au = /(x + Ax, y + Ay) - /(x, y). 

Adding and subtracting /(x, y -f- Ay) in the right-hand member 
of (23-1) give 

Au = [/(x + Ax, 2 / -f Ay) - /(x, y + Ay)] 4- [fix, y + Ay) 

- /(*, y)]- 

The expression in the first bracket represents the increment 
received by the function fix, y + Ay) when x undergoes a change 
of magnitude Ax; whereas the second bracket gives the increment 
of the function fix, y) when x is kept fixed. 

The application of the mean-value theorem gives 

fix + Ax,^y + Ay) - fix, y + Ay) = /,(x + 0i Ax, y + Ay) Ax, 
fix, y + Ay) - fix, y) = /,(x, y + Ay) Ay, 

where 0i and Ot are numbers between 0 and 1. Then Au can 
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be written in the form 

(23-2) A« = -f $1 Ax, y -i- Ay) Ax -f fy{x, y + Ay) Ay. 

If it is assumed that the partial derivatives /, and fg are 
continuous functions of x and y, then 

lim Mx + Bi Ax, y + Ay) = f,{x, y), 

A*-*0 

Ay-»0 

and 

lim fy[x, y + Bi Ay) = fy(x, y). 

Ay—»0 

The last two equations can be rewritten to read 
(23-3) y + ^y) = fx(x, y) + 7/1 

\fv(x, y + 62 Ay) = fy(xy y) + 172 , 

where 771 and 772 tend to zero when Ax —► 0 and Ay —» 0. 
Substituting from (23-3) in (23-2) gives 

(23-4) Aw = ^ Ax + ^ Ay + 771 Ax + 772 Ay. 

The sum of the first two terms in the right-hand member of (23-4) 
is called the principal part of the increment Aw, or the total 
differential of w, and is denoted by the symbol 

(23-5) d« = ^ da: + dy. 

As in the case of a function of a single variable, the increments 
and the differentials of the independent variables are identical, 
so that dx = Ax and dy = Ay. 

Since 771 and 772 are functions of Ax and Ay that tend to zero 
with Ax and Ay, the expressions 

771 Ax and 772 Ay 

are infinitesimals of higher order* than Ax and Ay. Accordingly, 
for small values of Ax and Ay, the value of Aw is very nearly that 
of dw.f 

* It will be recalled that a variable whose limit is zero is called an infini- 
tenmal. If ^ 0, where a and /3 are infinitesimals, or is said to be of 

higher order than /3. 
t See Prob. 6, p. 66. 
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Formula (23-4) is analogous to that developed in Sec. 16 
for the increment of the function of a single variable a;, where it 
was found that 

Ay = /'(x) Ax -f r? Ax. 

Since u = /(x, y), (23-5) can be written as 

(23-6) du = ^dx + ^ dy. 

The extension of formula (23-6) to functions of any number of 
variables is immediate. If w = /(xi, X 2 , • • • , Xn), where 
X 2 , • • • , Xn, are the independent variables, the differential 
of u is defined as 


(23-7) du = ^ dxi-\- ^ dx 2 * * * + ^ 

uX\ vX 2 vXfj 

Theorem. If xi, xt, ■ • ■ , Xn are independent variables and 

u = fixi, Xt, • • • , Xn) is continuous together with its partial 

derivatives, and if 

(23-8) du = Pi{xi, X 2 , • • • , Xn) dxi -|- Ptixi, Xi, • • • , x„) dxt 

-I- • • • -F PniXl, Xi, ‘ ■ Xn) dXn, 

Onen 

. p _ 


p _ du 


P = —, 
dxt 


dXn 


Since the variables are independent, one can set 
dxt = dxj = • * • = dxn — 0 
in (23-7) and (23-8) to obtain 


Thus 


du = dxi = Pi dxt 

OXi 

Pi = and so forth. 

dxi 

Corollary. If du = 0, then ^ ^ = 

oXi 0X2 


du 

d^ 


= 0 . 


PROBLEMS 

1. Find the partial derivatives of the following functions: 

(o) log (x* + y* + 2 *); 

(b) e*cosxy; 

(c) X* - 3»*y + «*; 
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(J) sin 


«* + «»’ 


ig) tan-»p; 

(h^ ^ ~ y - 

X + y’ 

(f) «-* sin y. 

8. Find the differentials of the following functions: 

(o) (x» + y* + s*)^: 

(6) (x» + y* + 

(c) xlog(x* + *’); 
id) log tan (x* + y’); 


' ' X + y 

3. What are the values of the partial derivatives of 

X — y + 1 
* ” X + y - 1 

at (0, 0)? 

4 . Find the partial derivatives of 

x = r cos 0 sin 
y = r sin ^ sin 
« = r cos df 

with respect to r, 6. and tp. 

6. If tt * a;*y + |/’2 + verify that 

6. It was remarked in Sec. 23 that for small changes ir. ohe values of 
the independent variables! the change in the value of the function is 
nearly equal to the magnitude of the differential. This fact can be used 
to calculate the approximate error in the quantity/(x, y, z) determined 
by measurements of x, y, and z. The error in /, due to small errors 
dx, dy, and dz in x, y, and is approximately equal to 

4r.|dx + |dy + |dr. 

SgJI that the approximate relative error ^ is equal to d log/. 
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7. Referring to Prob. 6, find the approximate error in calculating 

the area of a triangular piece of land, two sides of which are measured 
as 125 and 100 ft., respectively, and the included angle as 60.® The 
possible error in measuring the sides is 0.2 ft. and that in the measure 
of the angle is 1®. Hint: A = }^xy sin a. Ans. 74.0 sq. ft. 

8. In estimating the cost of a pile of bricks measured as 6 X 50 X 4 ft., 

the tape is stretched 1 per cent beyond the estimated length. If the 
count is 12 bricks to 1 cu. ft. and bricks cost $8 per thousand, find the 
error in cost. Ana, $3.46* 

9. In determining specific gravity by the formula a = where 

A is the weight in air and W is the weight in water, A can be read within 
0.01 lb. and W within 0.02 lb. Find approximately the maximum error 
in «if the readings are A = 1.1 lb. and W = 0.6 lb. Find the maximum 


relative error —• 
a 


0.112; 0.054. 


10. The period of a simple pendulum with small oscillations is 


If T is computed using ^ = 8 ft. and ^ = 32 ft. per second per second, 
find the approximate error in T if the true values are I = 8.05 ft. and 
g = 32.01 ft. per second per second. Find also the percentage error. 

Ana. 0.003^; 0.3 per cent. 

11. The diameter and altitude of a can in the shape of a right circular 

cylinder are measured as 4 in. and 6 in., respectively. The probable 
error in each measurement is 0.1 in. Find approximately the maximum 
possible error in the values computed for the volume and the lateral 
surface. Ana. l.fiir; ir. 

12. Show that the relative error of the product is equal to the sum of 
the relative errors of the factors. 

24. Differentiation of Composite Functions. Let u = f{x, y) 
be a function of the variables x and y which in turn are functions 
of some independent variable t. If t is given an increment Af, 
the functions x and y will acquire increments Ax and Ay, and, 
consequently, u wdl receive an increment Au. 

Assuming that u = /(x, y) is continuous together with its 
partial derivatives, one can write [see (23-4)] 

Att = A* + Ay + iji A® + ij, Ay. 

Dividing both sides of this expression by Af gives <• 


(24-1) 


du A® , Ay , A® Ay 

“ d® At dy ST At At' 
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Now if it be supposed that x and y can be differentiated with 
respect to t, the expression (24-1) gives, upon passing to the limit 
as A< —> 0, 


(24-2) 


' du _ dudx . dudy 
dt ~ dxdt '^'dydt 

_ ^ y % 

dx dt dy dt’ 


since rii—^0 and t; 2 ~> 0 . The reason for the vanishing of 171 
and 1/2 as —> 0 is that 171 and 172 are functions of Ax and Ay, 
and since x and y are assumed to be differentiable functions of t, 
they are surely continuous in t. 

Formula (24-2) gives the rule for the differentiation of com¬ 
posite functions. It is clear that if w is a function of a set of 
variables, Xi, X 2 , • • • , Xn, where each variable is a function of 
an independent variable t, the derivative of u with respect 
to t is given by the formula 


du 

dt 


du dxi , 

dxi dt dX2 dt 


+ 


_L — ^ 
dXn dt ‘ 


A special case of formula (24~2) is of interest. If it is assumed 
that ^ = X, (24-2) becomes 


(24-3) 


du 

dx 


du , du dy 
dx dy dx 


Formula (24-3) can be used to calculate the derivative of the 
implicit function given by 


(24-4) 


fix, y) = 0. 


Let it be assumed* that (24-4) can be solved for y to yield a 
real solution 


(24-5) 


y = vM; 


then the substitution of (24-5) in the left-hand member of (24-4) 
pves an identity 0 = 0, or 

f[x, vix)] s 0. 

Thus the constant zero defines an implicit function of x, namely, 

* For general theorems regarding the conditions to be satisfied by /(z, y) 
if solution is to be possible, see Chap. XII. 
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(24-6) 0 = f(x, y), where y = <p{x). 

Applying (24-3) to (24-6) gives 


and solving for 


(24-7) 


0 = ^ 4 -^^ 

dx dy dx 


dy _ dx 
dx ^ 


The formula (24-7) implies that ^ must not vanish for the 

point (xo, Vq) at which the derivative is calculated. 

Example 1. Let /(x, y) = cos y = 0. 

^ = 9xV^ + cos yy ^ = &x^y — x sin y, 

so that 

^ __ 9x^y^ + cos y 

dx &x^y — X sin y 

for all values of x and y that satisfy the equation 


3x^y^ + X cos y = 0, 
and for which 6x^y — x sin y 0. 

Example 2. Let x^ + y^ = 0; then ^ " ^x, ^ = 2y. But 
it does not follow that 


^ = - 5 . 

dx y 

This result is absurd inasmuch as the only real values of x and 
y that satisfy x* 4- y* = 0 are x = 0 and y = 0. Since ^ 

vanishes at this point, the formal procedure used in obtaining ^ 
is meaningless. 
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Example 3. Let f{x, y) = 0 represent the locus of some curve 
and let P(xo> yo) be some point on the curve. The equation of the 
tangent line to the curve at the point P is 

It follows from (24-7) that this equation can be written in the 
form 

/»(^0,2/o)(a; ~ xq ) +/y(a:o, yo){y - yo) = 0 . 


PROBLEMS 

1. Find the equation of the tangent line to the ellipse 

Z. -f 5L - 1 
a* ^ 6* ' 

at the point (xo, yo)> 

2. Find the equation of the tangent line to the folium of Descartes 

+ y* — Boxy = 0. 

Note particularly the behavior of the tangent line to the folium at ( 0 , 0 ). 


8 . Find if 
at 


u = tan“^ - and 


Jy = -f e-^ 
a; = e* — e~^. 


4. Find the equation of the tangent line to the ellipse 

X = a cos By 
y = 6 sin B, 

at the point where B = ^ 

6 . (a) Find U u — e* sin yz and x = y = f — 1 , 2 = 7 ; 

at t 


du 


(b) find — and if w = x* — 4y*, x = r sec B, and y = r tan B. 

Of Ou 

6. (a) Find 4“ ^ u = x* -4- y* and y = tan x; 

ax ax 

(6) pven V •= f{x, y, z), where x = r cob 8, y = r sin 8, 

, , dV dV dV . , .dV dV . dV 

compute^, m terms of and 

7. The equation of a perfect gas ispv ^ RT. At a certain instant a 
given amount of gas has a volume of 16 cu. ft. and is under a pressure of 
36 lb. per square inch. Assuming R » 10.71, find the temperature T. 
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If the volume is increasing at the rate of cu. ft. per second, and the 
pressure is decreasing at the rate K lb. per square inch per second, find 
the rate at wh^ch the temperature is changing. Arts. 53.78; 0.93. 

26. Differentiation of Composite and Implicit Functions. The 

reasoning employed in the preceding section can be applied in 
obtaining the total differential, and hence the derivative, of a 
function of n variables 

U = y*(Xi, X2, * * * > 

where 

Xi = (t = 1, 2, • • • , n), 

are n differentiable functions of a single variable t. 

The resulting expression for the total differential is 

(25-1) du = ^ dxi + ^ dx 2 + • * • + -p- dXn. 

OXi 0 X 2 uXn 

A question arises concerning the validity of formula (25-1) 
in the case where the variables Xi are functions of several inde¬ 
pendent variables fi, fa, • • • , fm. Thus, let 

(25-2) u = /(xi, X 2 , • • * , Xn) 

be a function of the n variables x<, where the x, are functions 
of the variables fi, fa, * • • , fm, say 

(25-3) Xi = Xi(fi, fa, • • * , fm), (f = 1, 2, • • • , n). 


If all of the variables except one, say f*, are held fast, (25-2) 

becomes a function of the single variable tk and one can calculate 

df df 

the derivative with the aid of (25-1). The notation 

otk atk 

instead of is used to signify the fact that all variables except 
dtk 

tk are held fast. 

Assuming the continuity of the derivatives involved, one can 
write 


9f _ 

. df 

dxi 

+ 

df 

dxa 

+ • • 

• • + 

df 

dXn 
__—, 

afi 

dxi 

dti 

dxa 

dfi 

dXn 

dfi 

- 

_ df 

dxi 

+ 

df 

dXa 

+ • ■ 

• • + 

df 

dXn 

dfa 

dxi 

dfa 

dxa 

dfa 

dXn 

dti’ 

<• • • 

3 / _ 

.M. 

dxi 

+ 

df 

dxa 

+ • • 

• • + 

df 

dXn 

dtn, ■ 

dxi 

dU 

dXi 

dt„ 

dXn 

du 
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—t • • • > be multiplied respectively by dti, dtt, 

Ot\ Ot2 

, dtn and the resulting expressions added, one obtains 

_l_ . . A- Jt 










+t-“-+ 


S'"*) 


The left-hand member of this expression is the total differential 
of f{zi, 052, • • • , Xn)y regarded as a function of the independent 
variables fo, • • • , <m, whereas the terms in the parentheses 
in the right-hand member are precisely the total differentials of 
(25-3). Hence, one can write 

which shows that the formula (26-1) is valid whether the a;<’s are 
the independent variables or are functions of any set of other 
independent variables. 

The foregoing can be summarized as follows: 

Theorem. // w = /(xi, X2, • • ’ , Xn), 
then 

= I; • • ■ +£■**•• 


regardless of whether the variables Xi are the independent variables 
or are functions of other independent variables It is understood 


that all the derivatives involved ( the and 

\ dXk 


are continuous 


functions. 

Example. If /(x, y) = x^ -f y*, where x = r cos <p and 
y = r sin then 

df df dx , df dy « . o • 

= 2r cos* »> + 2r sin* <p = 2r, 
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= —2r* cos ^ sin ^ + 2r* cos ^ sin ^ = 0. 

Also 

df = 2r dr or d/ = 2x dx + 2 y dy. 

Let/(x, y, 2 ) = 0 define any one of the variables as an implicit 
function of the remaining ones. If x and y are thought to be the 
independent variables and one can obtain* (at least theoretically) 
a real solution for z in terms of x and y, it is possible to write 

dz ^ dx ^ dy. 
dx ^ dy ^ 

But 

Substituting the value of dz in this equation gives 

I *+ 1 ii,+ 1(1 <fc+ 1 #) - 0, 

or 


By the corollary to the theorem of Sec. 23, since x and y are 
independent variables, 


and 


df 

If 0 , these equations give 
oz 


dx dz dx 

^^^§1 = 0 
dy^ dzdy 


(25^) 


dz 

dx 


dx 


^ ’ 
dz 


dy 


dy 

dz 


The formulas (25-4) permit one to calculate the partial deriva¬ 
tives of thf function z defined implicitly by an equation 

/(*, y, *) = 0 . 


* See See. 113. 



74 


ADVANCED CALCULUS 


As an illustration, let 


x» + 2y* - 3x« + 1 = 0. 


Then, by (25-4), 


dz 2x — 3z j dz 4« 

3 “ - n—> and zr- — - 

dx —3x dy —Zx 


PROBLEMS 

du du 

1. Find ^ and —»if w = x* — a: = r sec and y = r tan 0. 

2. If F = f{x, y, z), where x = r cos 6, y = r sin 0,z = t, find 

i? ^ 
dr’ ae’ at 

,9V av ,av 

m terms of -z-j -5-1 and 

ax ay dz 

dy 

3. (a) Find g-i if a; sec y + = 1; 

(6) find ^ and if 
dx dy 

x’y — sin 0 + 2* = 0. 

4. If / is a function of u and v, where w ~ \/x* + y* and v = tan“^ 


dx dy \\ax) ^ \ayj 


6. If / is a function of u and v, where u = r cos 0 and t> = r sin 9, find 


9ra0yj\er) +r*W 


8. If » = os' 008 9 — y' sin 9, y = x' sin 9 + y' COB 9, prove that 

7. Find the total differential, if u — x* + y*f a; » r cos and 
y B r sin 0. 

8. If/ « e**', wherex « log (w* + v*) andy * tan“'^i 


Hi<si 
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(26 


A Tif W + t' . , ^ 1 1 

9. If 2 ? »= -- f u - yarnX, and v = e*'*, find — and 

1 —w ^ » * dx dy 

10. Find ~ and if 2 = x = tan (r — a), and y = «”. 

dr d« 1 + * 2 / 

26. Euler’s Theorem. A function/of n variables xi, 0 : 2 , • • • , 
Xn is called homogenecma of degree m, if upon replacement of each of 
the variables by an arbitrary parameter X times the variable, 
the function / is multiplied by X”*. In symbols this means that 
(26-1) /(XXi, XX2, • • • , XXn) = X’^/CXi, X2, • • • , Xn). 


Thus, 

f(^y Vi z) = —y^ - 2z^ 

f(^y y) = — X^ sin-^ 

M y) = sin I 

y> 


is homogeneous of degree 2, 
- is homogeneous of degree 1, 

is homogeneous of degree 0, 
is homogeneous of degree — 


Theorem. If /(xi, X 2 , • • • , Xn), continuous partial 

derivatives^ is homogeneous of degree m, then 


( 26 - 2 ) *1 ^ + Xi ■ ■ ■ + ^ • • • ,x,). 


In order to prove this theorem, set 

x[ = Xxi, xj = Xx 2 , * • • , x' = XXn. 

Then, since / is homogeneous of degree m, 

/(*i, aJ*, • • • , O = XVCaJi, 2:2, • • • , Xn). 

Differentiating with respect to X one obtains 

^ ** "^ ^ ** "^ ' * ' ^ ^ mX^-yCxi, X*, • • • , Xn), 

and setting X = 1 gives the desired result (26-2) since 


dxH dXk 


(A: = 1, 2, • • • , n). 


PROBLEM 


Verify Euler’s theorem for 
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(6) fix, y, «) = + ®j/* + 2 xyz', 

(c) /(*, y) = 

_ V® + y. 


W Six, y) = 
(e) fix, y) = 


y 

X* + 2/2 


27. Directional Derivatives. The relation expressed in (24-2) 
has an important special case when z and y are functions of the 
distance s along some curve C, which goes through the point 
(x, y). The curve C may be thought to be represented by a pair 
of parametric equations 

X == x(s), 

y = y(«), 

where x and y are assumed to possess continuous derivatives with 
respect to the arc parameter s. 


Q(x*4x,y^jy) 



Fio. 16 . 

Let P (Fig. 16) be any point of the curve C at which /(x, y) is 

df fif 

defined and has partial derivatives and ~ Let 

dx dy 

Qix + ^x,y + Ay) 

be a point close to P on this curve. If As is the length of the 
arc PQ and A/ is the change in / due to the increments Ax and 
Ay, then 

(*9 A«-»0 ^9 

^ves the rate of change of f along C at the point (x, y). But 
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dx .. A:r 
^ = lim — = cos a, 
ds A <*-^0 


Therefore, 

(27-1) 


as A«->o 


df df ^df . 

ds dx dy ^ 


and it is evident that ~ depends on the direction of the curve. 


For this reason 


is called the directional derivcUive, It 


represents the rate of change of / in the direction of the tangent to 
the particular curve chosen for the point (x, y). If a = 0 , 

ds dx 

which is the rate of change of / in the direction of the a:-axis. If 

T 

a « 2' J'l 

df _ 9f 


which is the rate of change of / in 

the direction of the y-axis. \ 

Let z = f(x, y), which can be \ \ 

interpreted as the equation of a \ C^jC 

surface, be represented by draw¬ 
ing the contour lines on the xy- - 

plane for various values of z, yiq, 17. 

Let C (Fig. 17) be the curve in 

the xy-plane corresponding to the value z = 7 , and let C + AC be 

Af A 7 

the neighboring contour line for 2 = 7 -f A 7 . Then ^ ^ ^ ^ 

the average rate of change of / with respect to the distance As 
between C and C + AC. Apart from infinitesimals of higher 
order, 

An , 

— = cos 
As ' 


where An denotes the distance from C to C + AC along the nor- 
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mal to C at (x, y), and ^ is the angle between An and A«; hence 

~ = cos Therefore 
os 


(27-2) 


d/ d/ dn d/ , 

:r = ‘ = zj cos \p. 

as dn ds dn 


This relation shows that the derivative of / in any direction may 
be found by multiplying the derivative along the normal by the 
cosine of the angle ^ between the particular direction and the 
normal. This derivative in the direction of the normal is called 
the normal derivative of /. Its numerical value obviously is the 

maximum value which ^ can take for any direction. In applied 
mathematics the vector in the direction of the normal, of magni¬ 
tude is called the gradient 

Example. Using (27-1) find the value of a which makes 
~ a maximum, considering x and y to be fixed. Find the 


expression for this maximum value of 

Since ^ cos a -f fy sin a, 
ds 


A(^) 

da\ds/ 


fx sin a + fy cos a. 


The condition for a maximum requires that 


tan ai = 

/* 

Using this value of ai, 


ai = tan~^ —• 


The relation (27-2) can be derived directly by use of this expres¬ 
sion for If a (Fig. 18) gives any direction different from the 
direction given by ai, then 

^ =/, cosa-f/, sina. 
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But a = ai — so that 
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^ = /»(cos ai cos ^ + sin ai sin + /y(sin ai cos ^ 


cos ai sin ^). 


cos ai = 


V/2+y; 


/» 

sm «1 = — ; ■■ -- > 

Vyi+/j 


X = / » cos ^ + f ’-JA', A ^ 

Vyi +/5 vTT+T! 

+ /» cos ^ - fv-J= sin ^ 


'V.^+7; 
^ JL±iLc 
V 5 r+ 7 | 

= -f- cos 4>. 
an 


I "vTJ+y; 

cos = vTT+Tj COS ^ 


PROBLEMS 


1. Find the directional derivative of/(a;, y) = a:*y + sin at ^ 

in the direction of the line making an angle of 45*^ with the rr-axis. 

2. Find 


(‘■i> 


dn y\dx/ \dy/ 


ifx = rco8 0,y^rBinff, and/ is a function of the variables r and f. 
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3. Find the directional derivative of /(rr, y) = x^y + in the direc¬ 
tion of the curve which, at the point (1, 1), makes an angle of 30° with 
the x-axis. 

4 . Find the normal derivative of /(x, y) = x® + y^, 

28. Tangent Plane and Normal Line to a Surface. It will be 
recalled that 

Ax + -Sy + Cx = Z> 

is the equation of a plane, where the coefficients A, By and C 
are called the direction components of the normal to the plane. 



If a, Py and 7 (Fig. 19) are the direction angles made by the normal 
to the plane from the origin, then 

+ B^ + C^ \/A^ + J52 + 

C 

cos 7 = -■ -/ ..-- 

+ Jg2 + (72 

Therefore, 

cos a:cos jSrcos 7 = .4 :B\C, 

If the plane passes through the point (xo, xo), its equation can 
be written as 

A{x - Xo) + B{y - 2/0) + C{z - zo) = 0 . 

There is also a normal form for the equation of a plane, entirely 
analogous to the normal form for the equation of the straight 
line in the plane. This form is 


X cos a + y cos + z cos 7 = p, 



§28 


FUNCTIONS OF SEVERAL VARIABLES 


81 


or 


VA* + B* VA* + B* 

_ D 

VA* + B* + C*’ 

in which v = — — r-P: . -— is the distance from the origin 

+ B^ + C^ ^ 

to the plane. 

Consider a surface defined by z = /(x, y), in which x and y 
are considered as the independent variables. Then 


(28-1) 


df 






dx 


dy 




If Xo and j/o are chosen, 20 is determined by 2 = /(x, y). Let 
Ax = X — xo and Ay = y — yo, and denote de by 2 — 20 . Then 
(28-1) becomes 


(28-2) * - *0 = ^ 


(x - Xo) + ^1 

(*o. Vo) <^| 


(x», yo) 


(y - Vo), 


which is the equation of a plane. If this plane is cut by the 
plane x = Xo, the equation of the line of intersection is 


z 



(y - yo), 

(xo. yo) 


and this is the tangent line to the curve z = /(xo, y) at the point 
(xo, yo, Zo)o Similarly, the line of intersection of the plane defined 
by (28-2) and the plane 2 / = yo is the tangent line to the curve 
z = /(x, yo) at (xo, yo, zo)- The plane defined by (28-2) is called 
the tangent plane to the surface 


z = /(x, y) 


at (xo, yo, zo)o 

The direction cosines of the normal to this plane are propor¬ 
tional to 


dx 


7 

(«o. yo) 


dy 


7 

(»o. vo) 


- 1 . 
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The equation of the normal line to the plane (28-2) at (xo, yo, «o) 
is therefore 


(28-3) 


X - ^ y — yo ^ z - zq 


3/ 



-1 

dx 

(zo, yo) 

dy 

(ZO, yo) 


This line is defined as the normal to the surface at (xo, yo, Zo). 
Figure 20 shows the difference between dz = BP' and Az = RQ. 



P{^oj 2 / 0 , Zo) is the point of tangency and R{xo + Ax, yo + Ay, Zo) 
is in the plane z = zq. PP' is the tangent plane. 

In case the equation of the surface is given in the form 


PM, y, z) = 0, 

the tangent plane and the normal line at (xo, yo, Zo) have the 
respective equations 


(2»4) 


and 


(». M. *•) 


(X - Xo) + 


dy 


(y - yo) 

(zo, VO. to) 

+ ^\ (2 - 2o) = 0 

|(*o. VO, to) 


(28-6) 


X — Xo _ y — yo _ z ~ ip 


dF 


dF 


~ dF 


dx 

(zo, VO, to) 

dy 

(xo, VO, to) 

dz 

(ZO, VO, Sfl) 


These equations follow directly from (25-4). 
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Example 1. At (6, 2, 3) on the surface a;* + y* + 2* = 49, 
the tangent plane has the equation 

2x1 (x - 6) + 2y\ (y - 2) + 221 - 3) = 0 

1(8. 2, 8) 1(6. 2, 8) 1(6. 2. 8) 

or 

6x + 2y + 32 = 49. 

The normal line is 

x-6_y — 2 2-3 

12 4 6 ■ 

Example 2. For (2, 1, 4) on the surface 2 = x^ + ^/^ — 1, the 
tangent plane is 

2 - 4 = 2x1 (x - 2) + 2d {y - 1) 

1 ( 2 . 1 ) 1 ( 2 . 1 ) 

or 

4x + 22/ — 2 = 6. 

The normal line is 

X - 2 ^ y - I ^ g - 4 
4 2 -1 ' 

PROBLEMS 

1. Find the distance from the origin to the plane x + 2 / + g = 1. 

2. Find the equations of the tangent plane and the normal line to 

(а) 2 x* + 3 y 2 + 42^ = 6 at ( 1 , 1 , M); 

^2 ,y2 «2 

(б) I + I - ^ = 1 at (4, 3, 8); 

(c) ^ + I5 + ^ = 1 at (ak), yo, 2o). 

3. Referring to (28-4), show that 

^ dF dF dF 

cos a: cos p: cos y = 

dx dy az 

where cos a, cos jS, cos 7 are direction cosines of the normal line. 

4. Show that the sum of the intercepts on the coordinate axes of any 

tangent plane to x^ -f is constant. 

29. Space Curves. It will be recalled that a plane curve C 
whose equation is 

(29-1) 


v = /(®) 






so selected that when t runs through some set of values, the 
coordinates of the point P{x, y, «), defined by (29-3), trace out 
the desired curve C. 

It will be assumed that the functions in (29-2) and (29-3) 
possess continuous derivatives with respect to which implies 
that the curve C has a continuously turning tangent as the point 
P moves along the curve. 

Let P(a5o, yo, «o) (Fig. 21) be a point of the curve C defined by 
(29-3) that corresponds to some value of the parameter ty 
and let Q be the point (xo + + Ay, -{- A^;) that cor> 
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responds to < = <o + Ai. The direction ratios of the line PQ 
joining P and Q are 


Ac Ac'Ac At'At'At 

If At is allowed to approach zero, Ax, Ay, and Az all tend to zero, 
so that the direction ratios of the tangent line at P(xq, Zo) 



tion of the tangent line to C at P is 


Hence, the equa- 


X — xo _ y — yo _ z — zo 
x\to) y'(to) z\to)' 

where primes denote derivatives with respect to L 
Example. The equation of the tangent line to the circular 
helix 


X = a cos t, 
2 / = a sin t, 
z ^ at. 
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at ^ = 51 is 
o 


a 

2 ^ 


The element of arc ds is given by 

(ds)» = {dxY + (d2/)“ + m\ 

so that the length of a space curve C can be calculated from 

The length of the part of the helix between the points (a, 0 , 0 ) 


( 0 , a, ”) it 


L-^a. 

2 


30. Directional Derivatives in Space. There is no essential 
difficulty in extending the results of Sec. 27 to any number of 
variables. Thus, if w =» /(x, y, z) is a suitably restricted func¬ 
tion of the independent variables x, y, and z, then the directional 
derivative along a space curve whose tangent line at some point 
P{Xy z) (Fig. 21 ) has the direction cosines cos (x, s), cos (y, s), 
and cos (r, s) is 

^ = - cos (X, 8 )+- COS iy, s) + ^ cos {z, a) 

_ dudx . du dy . du dz 
~ dx ds dy ds dz ds 

The magnitude of the normal derivative is given by 


Tn - 

PROBLEMS 

1 . Find the equation of the tangent line to the helix 
X ^ a COB t, y a Bin t, z ^ at, 

at the point where i = 7 * Find the length of the helix between the 
4 

X 

points t “ 0 and t « j- 
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2 . Find ♦’le directional derivative of / = xyz at ( 1 , 2 , 3 ) in the direc¬ 
tion of the line that makes equal angles with the coordinate axes. 

3. Find the normal derivative off = x^ + y^ + z^ at ( 1 , 2 , 3 ). 

4 . Show that the square root of the sum of the squares of the direc¬ 
tional derivatives in three perpendicular directions is equal to the 
normal derivative. 

6 . Express the normal derivative (30-1) in spherical and cylindrical 
coordinates, for which the equations of transformation are 
(a) X = r sin 0 cos <pf y = r sin ^ sin 2 = r cos 6 ; 

{b) X = r sin By y = r cos 0, z = z. 

31. Partial Derivatives of Higher Order. The first partial 
derivatives of a function /(xi, X 2 , • • • j Xn) are functions of 
xiy X 2 , • • • , Xn and they may have derivatives with respect to 
some or all of these variables. These derivatives are called 
second partial derivatives. 

If there are only two variables x and y the function u = fix, y) 
may have the second partial derivatives 

dx dx dx^ 


d df _ ay 
dy dx ““ dy dx 

dx dy 
d 


dx dy 


— fieVf 

= fyxj 


dy dy dy^ 

It should be noted carefully that 


means that 


dx 


is found first and the result is differentiated with respect to 


dH dH 

y. Thus . ■- and — differ in the order in which the differ- 

dy dx dx dy 

entiation is performed, and, consequently, the results may be 
different. The following theorem, due to Schwarz,* states 
sufihcient conditions for inversion of the order of differentiation. 

Theorem. If fxj fy, and fry exist in the vicinity of the point 
{Xj y) and if f^y is continuous at (x, y), then fyx exists at this point 
and is identical with fxy. 

Form the function 


(31-1) » <p{x) 3 fix, y + k) - fix, y), 

* Db la Vall4b Poussin, C. J., Cours d’analyse infinit^simale. vol. 1, 
p. 146. 
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which for a fixed y and k satisfies the conditions of the mean- 
value theorem. Hence, making use of (20-4), 

<p(x + A) — <p(x) = h<pa;(x + dih) 

— h[fx(x -f- dih, y + k) — fx(x H- Bihj y)], 

where 0 < < 1. 

The expression in the brackets is a function of y to which the 
mean-value theorem is applicable, so that 

U(x + Bihj y + k) - fx(x + BJi, y) = kfxy(x + Bih, y + B 2 k). 
Since/av is assumed to be continuous at (x, y), 

fmi^x + ^lA, y + B^k) = fxyix, y) -f €, 

where 

lim € = 0. 

h-*0 

Therefore, 

(31-2) (p{x + A) - <p(x) = AA[/*y(x, y) + c]. 

From thfe defining equation (31-1) it is seen that (31-2) is 
equivalent to 

fix + h,y + k)-fix + A, y) - /(x, y + k) + fix, y) 

= Afc[/xv(x, y) + €]. 

Dividing through by k gives 

fix + h,y + k) - fix + A, y) /(x, y + k) - /(x, y) 
k k 

= A[/*y(x, y) + c]. 

Passing to the limit as fc —> 0, one obtains 

fyix + A, 2/) ~ fyix, y) = hfxyix, y) + h lim €, 

k —>0 

or 

y) . „) + lim .. 

^ Jb—^ 

The limit of this expression as A —♦ 0 is 

/».(*» y) = U(.x, y). 

Thus the order of differentiation is immaterial if the assump¬ 
tions regarding the partial derivatives are satisfied. These con¬ 
ditions certainly will be satisfied if it is known that /, and 
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possess derivatives and fyx which are continuous functions. 
The theorem is true under less restrictive conditions, but the 
detailed statement of these conditions is so involved that it will 
not be given here.* 

From the result just established it is clear that 


fxxy(x, y) = fyxx(x, y), 

if these partial derivatives are continuous. For 


SxTuix, y) 


^^fx{x, y) ^ d^fxjx, y) 
dy dx dx dy 


— fxvx{Xy y) — fyxxiXy 2 /)» 


32. Higher Derivatives of Implicit Functions. The problem of 
calculating the derivative of y with respect to x when y is an 
implicit function of the independent variable x defined by 

(32-1) f{xy y) = 0, 

was discussed in Sec. 24. It was shown there that 


(32-2) 


Ux, y)+fAx,y)^ = o. 


Differentiating this equation again and assuming that all the 
derivatives involved are continuous functions of x and y, gives 

(32-3) y) -1- 2/^(x, J/) ^ + fmix, y)(^ 

+ Mx,y)^^ = 0. 

If fvi^j y) 7 *^ 0 at the point where the derivative is desired, 
(32-3) can be solved for ^ and the value of ^ substituted 
from (32-2). The result is 

_ _ fxxfl 2/ey/g/y -|~ fwfx 

dx^ fl 

The process can be continued to obtain the derivatives of higher 
orders. 

A similar procedure can be employed to calculate the partial 
derivatives of a function z of two independent variables x and y 
defined implicitly by an equation of the form 

(32-4) . fix, y, z) = 0. 

* See E. W. Hobson, Theory of Functions of a Real Variable, vol. 1, 
pp. 424-429. 
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Differentiating (32-4) with respect to z and y in turn gives 


(32-5) 


/.(*, y, *) +/.(*, 0 . 

/»(a:, y, 2 ) + /,(*, J/. 2) = 0- 


£f /,(®, y, z) does not vanish for those values of x, y, and z that 

satisfy (32-4), then Eqs. (32-5) can be solved for ^ and — 

Partial derivatives of higher order can then be obtained by differ¬ 
entiating equations (32-5). 

Example. Let it be required to find the derivatives of second 
order of the function z defined implicitly by the equation 


a* 6* "f ^2 


= 1 . 


Differentiating this equation with respect to x and y gives 


(32-6) 


2x . 2zdz _ 
dx 

2y . 2zdz _ 
dy 


Differentiating the first of Eqs. (32-6) with respect to x and y, 
one obtains 



+ 


- o 

c* dx^ “ 


c* dx dy c* dx dy 


Solving for and 


d^z 
dx dy 


and making use of (32-6), one obtains 


d^z __ a^z^ + c^x^ 
dx^ ~ sfi * 

d^z _ c* xy 
dx dy "" 

In a similar way the differentiation of the second of Eqs. 
(32-6) with respect to y yields 
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1. Verify that 


dv 


PROBLEMS 


dy dx 


for 


dx dy 

(a) / = cos xy*; 

(b) f = sin’ X cos y; 

(c) / = e»^»; 

(d) / = (x* + 

(c) / = (x’ - 2j/)’ + -v/xy- 

2. Prove that if 

(o) /(», y) = log (x* + y») + tan-’ ^ then ^ = 0; 

X ax* oy* 

W /(*, y. «) = (a:* + y* + then |^ + |^ + |^ = 0- 

3. Find y', y", y'", if x» + y* — 3axy = 0. 


. j diJ d*2; 

4. Find » 


3.' 3,' 3x-- sHi’ S “ ” 


6. Find if 
dx 


(а) x«* — y2^ + — 6 =» 0; 

(б) xz^ — yz + 3xy = 0. 

33. Change of Variables. In a great variety of problems in 
analysis it is required to express the derivatives of a given func¬ 
tion of one set of variables in terms of another set of variables. 
Some of the simpler problems of this sort were discussed in Secs. 
24 and 25. This section contains a formal treatment of several 
of the more difficult of such problems. The question of the 
existence of solutions of the equations to be considered in this 
section will be left open until Chap. XII, where the problem 
of the differentiation of implicit functions will be reexamined 
in the light of the existence theorems established there. 

The sole purpose of the present section is to develop manipula¬ 
tive skill in calculating the derivatives of implicit functions and 
to indicate the formal modes of attack on the problem. The 
continuity of the functions and their partial derivatives is 
assumed throughout this section and will not be referred to again. 
Let 

(33-1) w = f(u, v) 

denote a ftinction of two independent variables u and v, and 
suppose that u and v are connected with some other variables 
z and y by means of the relations 
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(33-2) 


X = x(m, r), 

y = y(tt, »)• 


If the equations (33-2) are solved for x and y to yield 

/oo O'V /« = y). 

and the expressions (33-3) are substituted in (33-1) for u and 
V, there will result a function of x and y, say, 

(33-4) ii; = F(x, y). 

The partial derivatives of w with respect to x and y can be 
calculated from (33-4) directly, but frequently it is impracticable 
to effect the solution (33-3), and it is desirable to consider an 
indirect mode of calculation. By the rule for the differentiation 
of composite functions. 


(33-6) 


^ dw _ ^ ^ . dw dy 
du ~~ dx du dy du 
dw _ , d\V ^ 

dv ^ dx dv dy dv 


The partial derivatives and can be calculated 

^ du du dv dv 

from (33-2), and hence they may be regarded as known functions 

of u and v. The partial derivatives in the left-hand members 

of (33-5) are also known functions of u and v since they can be 

calculated from (33-1). 

Hence, equations (33-5) may be regarded as linear equations 

for the determination of ^ and Assuming that 

ax ay 


J{u, v) s 


to 


du 

du 

dx 

dy 

dv 

dv 


^ 0 , 


and solving by Cramer’s rule gives 



dw 

dy 


a* 

dw 


du 

du 


du 

du 


dw 

By 


dx 

dw 

dw _ 

dv 

dv 

dw 

dv 

dv 

dx ^ 

J(u 

; ») 

' dy~ 

J{u, 
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The resulting expressions for ^ and ^ are known functions 

ox ay 

of u and v and thus can be treated exactly like (33-1) if it is 
desirable to calculate the derivatives of higher orders. 

As an example, consider the function w(r, 6), and let it be 
required to calculate the partial derivatives of w with respect to 
X and y, where x = r cos 6 and y = r sin 6, Now 


dw 

dr 

dw 

'M 


dw dx . dw dy 
dx dr dy dr 
dw dx dwdy 
~^de dy ^ “ 


dw a , dw . ^ 

dx dy ^ 

dw , ^ . dw 

r sin 9 + —r cos 6, 
dx dy 


Solving these equations for ^ and ^ in terms of ^ and ^ 

dx dy dr dB. 

gives 

dw ^ dw sin 9 dw 

dw . ^dw , cos 9 dw 

The function J is, in this case, 

Icos 9 sin 9 

= 

—r sin 9 r cos 9 


which does not vanish unless r = 0. 

As a somewhat more complicated instance of implicit differ¬ 
entiation, consider a pair of equations 


(33-6) 


'F{x, y, u, r) = 0, 
G{x, y, u, v) = 0, 


and let it be supposed that they can be solved for u and v in 
terms of x and y to yield 


(33-7) 


u = u{x, y), 
V = v{x, y). 


The partial derivatives of u and v with respect to x and y can 
be obtaine/1 in the following manner. Considering x and y as 
the independent variables and differentiating equations (33-6) 
with respect to * and y gives 



94 


ADVANCED CALCULUS 


S88 


(33-8) 


dx dudx^ dv dx ’ 


ay aw ay ■'■ a» ay 


la® aw a* ■*■ at; ax ay ''■ aw ay ■*■ a» ay 


aF 


du 

dv 



du 

dv 


Equations (33-8) are linear in and ^• 

a® ay a® ay 

As a consequence of the hypothesis that Eqs. (33-6) possess 
the solution (33-7), it follows that 


J («, v) = 


in the repon for which the solution (33-7) is valid.* Accord¬ 
ingly, the partial derivatives in question can be determined from 
(33-8) by Cramer’s rule. 

A special case of Eqs. (33-6) is interesting. Let 
® = /(«, v), 

y = a(«, »)• 

Differentiating these equations with respect to x and remembering 
that X and y are independent variables, one obtains 


(33-9) 


^ _ df du . df dv^ 
du dx dv dx* 

; du dx dv dx 


These equations can be solved for ^ and if 


Jiu, v) = 


Example 1. Let 

tt* — 2* = 0, 

u» — y = 0. 

* The proof of this assertion is ^ven in Chap. XIL 



Sf 

du 

dv 


dg 

du 

dv 

v^ + 2x = i 
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Differentiating with respect tc x, 


Hence 




dx v} + v® bx 

Differentiating the first of these results with respect to x gives 


+ !»*) + 21 


/ bu , dA 

V3J + '’aij“ 


bx^ {u^ + 

_ u{u^ + v^) — 2u{u^ — v^) _ — w*) 

( 1^2 + • “ ”^2 + t; 2 )» * 

One obtains similarly i^igher derivatives. 


Example 2. Let 


ix ^ U + Vy 

(y = 3w + 2v, 


Differentiating with respect to x, 

dx dx^ 

0 = 3^ + 2f. 

dx dx 


SO that 


dw __ « ^ ^ o 

bx dx 


It is easily checked that 

^ — 1 ^ — _i 

Equations (a) can be solved for u and v in terms of x and 
and the result is 


u = -2x + 2 /, 
» = 3x — y. 
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Regarding u and v as the Independent variables and differentiat¬ 
ing these equations with respect to u, one finds 

1= _2|f+ 1*', 

du du 


. _ _ dx dy 


Hence, 


du dx 

It should be noted that ^ and ^ are not reciprocals in general, 

as, of course, is obvious from (33-9). 

Example 3. U w ^ uv and 


(u^ + v -f X = 0, 
\v^ — u — y = 0, 


one can obtain — as follows: Differentiation of w with respect 
to X gives 

dw dv , du 

The values of ^ and ^ can be calculated from (6) as was done 
dx dx 

in Example 1. The reader will check that 

dw ^ u + 2v^ dw _ 2u^ — V 

dx 1 -f 4uv dy ^ 1 + 4uv 

PROBLEMS 

1 . If ti* + 1 ;* + y* — 2 x = 0 , -h — X* + 3y = 0 , find 

dx dx dy 

and 3 — 

dy 

_ _ . du> , Bw u 

2. Find T- and :r‘» « w ■= -> 

dx dy V 


ix = « + », 
}y - 3« + 2o. 


and 
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8. Show that if f{x, y, z) = 0, then ^ ^ = 1 and “ — !• 

ox dz dy oz ox 

dz Sx 

Note that in general ^ and ^ are not reciprocals. 

4. K * = x(«, v), y = y(u, v), and ^ and ^ then 

dho dho _ /dhv /dxV / 

du* dv^ \da;* dy^/\_\du) \dv) J 


6 . Show that the expressions 

and 


_ / d^Y / d^Y 

^ \dx/ \dy/ 


dx* dy*‘ 

upon change of variable by means of 

a; = f cos $f 
y = r sin d, 


become 

and 

6. Show that 


\dr/ ^ r\de) ' 


dr* r* dd* r dr’ 


d*F 

dt^ 


= c* 


d*F 

dx*' 


if jr = f(^x + cl) + g(x — cO, where / and g are any functions possessing 
continuous second derivatives. 

7. Show that 

dx* dy* * \dr» 66*/’ 
if » » COS d, y »= c** sin d. 

8. Fmd if 

«* — »* — ** + 3y = 0, 

u + 0 — y* — 2x 0. 
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9. Prove that 


a.— n 
dxdu dxdp ~ ' 


if F{x, y, tt, ») = 0 and G{x, y, u, p) = 0. 

10. If Vi(x, y, 2 ) and Vt{x, y, z) satisfy the equation 


then 


V*7 


d*V d*V d*V _ 
dx* ^ dy*^ dz* ’ 


U = Vi(x, y, z) + (x* + y* + 2*)7i(a:, y, z) 
satisfies the equation 


V* V* 1/ = 0, 



CHAPTER IV 
DEFINITE INTEGRALS 

34. Riemann Integral. The concept of a definite integral had 
its origin in problems dealing with the determination of the area 
under a curve. Despite the fact that the refined concept of 
what is known as the Riemann integral is very far removed from 
the geometrical notions that led to its definition, it seems desirable 
to begin the study of Riemann integration by presenting a rea¬ 
sonably careful definition of the definite integral based on the 
intuitive concept of the area under the curve. An analytical 
definition of the Riemann integral is given in the next section. 



The function f(x) considered in this section is assumed to be 
continuous and single-valued. Let the interval of definition 
of the function he a ^ x S b, and assume that the graph of 
the function lies above the x-axis. The area bounded by the 
curve y = /(x), the x-axis, and the lines x = a and x = 6 will 
be denoted by 8 (Fig. 22). Divide the interval (a, h) into v 
parts by the points 

CL = Xo, Xi, X 2 , * * * > ^n—1| Xn ^ by 

whose abscissas satisfy the inequality 

Xi < Xi+1, (i == 0, 1, 2, • • • , » - 1), 

99 
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and draw through these points of subdivision a set of ordinates 

VU • • • I Vn-i- 

The area 8 will be divided into n vertical strips, the ith one of 
which has a base of length Aav s xj — Xi_i and an area A(S<. 

Denote the maximum and the minimum values of the function 
y = fix) in the interval Aa:< by Mi and m<, respectively, and con¬ 
sider the rectangular areas 

nii Axi and Mi Axi. 

Clearly, 

Mi Axi ^ ASi ^ Mi AXi, 

so that the area 8 is not less than 


(34-1) 8„sVm,Ax<, 

1-1 

which represents the sum of the areas of the inscribed rectangles. 
On the other hand, the area S is not greater than 


(34-2) 8n^X^iAxi, 

which stands for the sum of the areas of the circumscribing 
rectangles. Therefore, one can write 

(34-3) s» ^ S ^ 8„. 

The difference between (34-2) and (34-1) is 


(34-4) — Sn = 5) 

and if the number n of subdivisions is increased indefinitely 
in such a way that all of the subintervals Axi —* 0, the difference 
Mi — nii will also tend to zero, since ^(x) is co ntinuous, 
does not follow without proof that StT— Sn wilPtend to zero, 
since the number of terms in the sum increases with the increase 
in n. It will be shown, however, that this is the cas^ 

Consider the set of numbers ^ 

Afi - me, (i == 1, 2, • • • , n), 

associated with some particular mode of subdivision of (a, 6) into 
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n parts, and denote the of these numbers by d». Then 

the sum in (34-4) certainly will not be decreased if each Mi — mi 
is replaced by d», so that 

n 

Sn — 8n^ AXi = dn(p — o). 

t-1 


But Sn — «n is nonnegative, so that 

0 ^ Sn — 8n ^ dn{b — tt), 
and since dn —> 0 when n oo, it follows that 


lim (Sn - Sn) = 0, 

n—♦ «o 

or 

lim /S« = lim s„. 

n-» 00 n—^ «o 


The area S, under the curve y = /(x), as is seen from (34-3), 
is intermediate to Sn and Sn, and since both and Sn have the 
same limit, it is clear that their common limit is S. Thus, 


Moreover, let 


lim Sn = lim S, 




[x^ auii puiiit luThe int^al Axt, and form the 


sum 


S'n * AXi, 


which represents the sum of the areas of rectangular strips whose 
heights are intermediate to mi and Mi, so that 


Since 

it follows that 


Sn. 


lim Sn = lim Sn = S, 

n-* *0 n—> *0 


Urn s; = s. 


Hence, the sum Si may be constructed for an arbitrary choice of 
the point in the subinterval Ax,-, and its limit will be the same. 
This leads to the following definition: 

Definition. Let f(x) be a continiums function defined in the 
inlerwd a S z Sb. Let the interval (a, 6) be divided into n sxh- 
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tfUervals by inserting the points of subdivision Zi in such a way thaJt 
a ^ Xfi < Xi < X% < • • • < Xn^l < Xn^b. 

Let be any point in the interval of length Axi = — as<-i. The 

limit of the sum 

n 



The geometrical reasoning that led to the definition of the 
integral of Riemann involved an assumption that f(x) is a non¬ 
negative function. The fact that this assumption is not an 
essential one can be seen from the following considerations. 
Assume first that f(x) is negative throughout the interval (a, 6). 
Then each term in the sum 


f-1 

is negative, and the limit of the sum will be a negative number. 
Hence, areas lying below the x-axis must be reckoned as negative. 

If/(x) is not always of the same sign, denote the smallest value 
of f(jx) in (a, b) by —m (Fig. 23). Then the function 

Fix) = fix) + m 
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is positive or zero throughout the interval (o, h), and one can form 
the integral of F{x), namely, 

dx — dx 


= lim y [/(I.) + m] AXi 

n—* «o ^ 

» —1 

n n 

= lim ]£/({<) Lxi + lim Vm Ax<. 

The second term in the right-hand member of this equation gives 
fn(6 — o), and if the integral of F{x) exists, 

n 

will surely exist. 

The restriction that a be less than h likewise can be removed. 
Thus, suppose that a > b, and let the interval (b, a) be sub¬ 
divided into n parts by the points such that 

a ^ Zo > Xi > X2 > • • • > Xn-l > Xn = b. 

Then the difference 


Xi — Xi-i = Ax< 
is negative, so that the value of the sum 

n 

»-l 

will differ only in sign from the corresponding sum appearing in 
the definition. Hence, 

jy(x) dx = -f“f{x) dx. 

In view of this relation (as well as from the geometrical inter¬ 
pretation of the definite integral), it appears sensible to say 
that 


dx =• 0. 

It should be noted that the value of the definite integral 
J** f{x) <2x is a number S which certainly does not depend on the 
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choice of the letter used to denote the variable of integration. 
Consequently, the letter denoting the variable of integration 
can be changed at will. Thus, 

dx = J[V(0 dt. 

The foregoing discussion was restricted to the consideration 
of continuous functions only. However, the limit of the sum, 
figuring in the definition, may exist and be independent of the 
mode of subdivision of the interval (a, h) into subintervals 
(as well as of the choice of fc), even if f{x) is not continuous.* 
Any function for which the integral of Riemann exists is said to 
be integrable in the sense of Riemann, 

It is left to the reader to show: 

{^That whatever be the choice of the three numbers a, 6, and c, 

dx = dx +SM dx; 

(6) That if fi(x) andf^ix) are two integrable functionsy then 

+/2(*)] dx = J[Vi(») dx + dx; 


(c) That if fix) is an integrable function and c is any constant. 


(c) That 
ther^^ 


f^cfi^) dx = dx; 


(d) tjL if 

x), ti 

jj[V(®) ^ ^ a < b. 


|/(x)| denotes the absolute value of the integrable 
fundi^/fix), then 


86. Riemann Integral iContinued). The existence of the com¬ 
mon limit S of the sums Sn and Sn in Sec. 34 hinged upon the 
geometrical concept of the area bounded by the curve y — fix), 
the ordinates x — a and x — b, and the x-axis. A geometrical 
argument does seem convincing enough until one begins to 
inquire carefully into the possibility of graphical representation 
of continuous functions. It was indicated above that one need 


^See Sec. 35. 
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not go very far out of his way to meet some continuous functions 
which cannot be represented graphically. The function 


/(x) = X sin -> if X 7 ^ 0, 

x 

= 0, if x = 0, 

in the vicinity of the origin is one such example. The reader may 
be inclined to disregard the seriousness of the situation since 
this function misbehaves only at one point of the interval, namely, 
where it fails to have a derivative, but it was demonstrated by 
Weierstrass that there are continuous functions that fail to have 
a derivative at any point of the interval. Such pathological 
behavior of continuous functions led to a careful inquiry into 
the meaning of such geometrical concepts as the area under a 
curve, the length of arc, the volume, etc., on which a considerable 
portion of analysis rested until the latter part of the last century. 
An offshoot of this inquiry was the theory of functions of a real 
variable, which is characterized by a complete absence of intuitive 
geometrical concepts. The exact meaning of the concept of the 
area under a curve is thus made to depend on an analytical 
definition of the definite integral, rather than the other way 
round. 

A brief outline of the analytical definition of the Riemann 
definite integral, together with the statement of some important 
theorems, is contained in this section. The treatment is neces¬ 
sarily condensed and glosses over some of the more intricate 
points, which properly must be deferred to a course in the theory 
of functions of a real variable. 

If the elements of a given set of numbers (E), when represented 
by points on the number axis, possess the property that there 
are no points of the set (E) to the right of some fixed point, then 
the set is called bounded on the right, or bounded above. If, on 
the other hand, there are no points of the set (E) to the left of 
some fixed point, then the set (E) is bounded below, or bounded 
on the left. For example, the set of positive rational numbers 
is bounded on the left but is unbounded above. The set of 
negative rational numbers is bounded above, but not below. A 
set of real numbers between 0 and 1 is bounded above and below. 
Every set bounded above and below is said simply to be hounded. 
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If a set of numbers (E) has the following properties: 

(t) there is no number of the set {E) which is greater than some 
number M; 

(ii) there is at least one number of the set (E) which is greater 
than M — e, where e is an arbitrarily small positive numbe,-, 
then tile number M is called the upper bound of the set {E). 

On the other hand, if the set {E) possesses the properties: 

(f) that there is no number of the set smaller than some number m; 

(ft) that there is at least one number of the set (E) which is 
less than m + <> however small the positive number e may be, 
then the number m is called the lower bound of the set (E). 

If one cares to take advantage of the suggestiveness of the 
language of geometry, then the meaning of the upper and lower 
bounds of a set of numbers is the following. The points of the 
bounded set (E) all fall in a segment of finite length, and the 
numbers m and M are the end points of the segment. It appears 
from this remark that every boimded set necessarily must have 
the upper and lower bounds. A rigorous arithmetical proof of 
this fact is based on the study of the linear continua and is not 
given here.* 

Denote the set of values assumed by the boimded function 
/(*) in (o, 6) by (E). Then the upper and lower bounds of the 
set (E) are called the upper and lower bounds of f(x) in (a, b). 
Let M and m be the upper and lower boimds of a bounded func¬ 
tion f(x) defined in the interval (a, b), and let (zi, x») be any 
subinterval contained in (a, b). Then the upper bound of f(x) in 
(xi, xt) certmnly will not be greater than M, and the lower boimd 
will not be smaller than m. Hence, if the interval (o, b) is sub¬ 
divided into n subintervals, and if the upper and the lower bounds 
of f(x) in each of the subintervals are denoted by Mi and mi, 
respectively (» = 1, 2, • • • , n), one is assured that ntt ^ m 
and M{ ^ M. This fact is of basic importance in what follows. 

Let the interval (a, 6) bo <livided into n subintervals by the 
points 

o « *0 < *1 < «* < • • • < »»-l <Xn^b, 
and form the sums 

n n 

iS = ^ Mi(xi — Xt-i) ^ Mi Axt 

* See, for example, E. W. Hobson, Theory of Functions of a Real Variable 
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n n 

a = ’^ntiixi - Xi_i) = '^niiAxi. 

i-1 t-1 

The sums S and s depend on a particular mode of subdivision 
of (a, b) into n parts, but for each particular mode of subdivision 
s ^ Sj since rrii ^ Mi. 

Consider the set of numbers S corresponding to all conceivable 
modes of subdivision. No matter what mode of subdivision is 
chosen, 

n 

(35-1) S = '^MiAxi£. M{b - a), 


n 

since Mi ^ M and = 6 — a. 

t-i 

Similarly, 


(36-2) 

Now, since 


8 = 


n 


rOi Axi ^ m{b — a). 


s < iS, 


it follows from (35-1) and (35-2) that 


and 


m(6 — a) ^ S ^ M{b — a), 
m(b — a) ^ 5 ^ M{b — a). 


These inequalities state that for any mode of subdivision of the 
interval (a, b) into n parts the sums S and s lie between m(b — a) 
and M(b — a), and therefore the sums S have the lower bound, 
say J, and the sums « have the upper bound, say 1. From the 
definition of these bounds it follows that 


and 


J ^ S 
I ^s. 


If each of the intervals Axi (in any particular subdivision) is 
subdivided further by inserting additional points and the new 
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sum S is formed for this larger number of subdivisions, then this 
new sum cannot be greater than the old 8, and in general it will 
be less. Moreover, the sum 8 arising from any mode of sub¬ 
division of (a, b) will not be less than the sum s resulting from 
this or any other mode of subdivision. This leads one to sus¬ 
pect that when the number n of subdivisions is increased indef¬ 
initely in such a way that each Axi —> 0, the sum 8 tends to a 
definite limit which is independent of the mode of subdividing 
(a, b) into subintervals Ax*, and that this limit is J. 

On the other hand, s will in general increase with the increase 
in the number of subdivisions, while remaining less than or equal 
to 8y so that it is likely that its limit is I. The correctness of 
these surmises was established for the first time in 1875 by the 
French mathematician Darboux, who enunciated the following 
theorem: 

Theorem. The sums 8 and s tend to definite limits J and /, 
respectivelyy when the number of intervals Ax* increases indefinitely 
in siLch a way that each and every Ax*- —► 0. Moreovery I ^ J. 

The proof of this theorem is given in books on the theory of 
functions of a real variable.* The numbers J and I are called, 
respectively, the upper and lower Riemann integrals of /(x) in 
(a, b). 

From the definition of the upper and lower bounds it follows 
that if (i is any value of x in the interval Axi, then 
mi ^ /(ii) ^ Mi. 

Therefore, 

n n n 

^niiAxi ^ '^fiii) Axi Mi Axi, 

t » 1 t« 1 < - 1 

and if it should happen that 

n n 

lim V 

that is, if / = then the sum 

n 

t-1 

♦ See Hobson, E. W., The Theory of Functions of a Real Variable, vol. 1, 
3d ed., p. 462; de la ValiJb Poussin, C. J., Cours d'analyse infinit^simale, 
^1. 1, 3d ed., p. 250. 



§86 


DEFINITE INTEGRALS 


109 


will have the same limit for any choice of the points Any 
bounded function whose upper and lower integrals are equal is 
said to be integrable in the sense of Riemann, 

It will be observed that if / = J, then the difference between 
the sums S and s, 

n 

'^{Mi — m,) Axi, 

must approach zero as n increases indefinitely and the Axi —> 0. 
This criterion enables one to show that every continuous function 
is necessarily integrable. For, if f{x) is continuous in the closed 
interval (a, 6), it is uniformly continuous there. Hence, the 
interval (a, b) can be divided into a finite number of subintervals 
Axi such that for any pair of values of x (say Xi and X 2 ) in the 
subinterval Ax* 

1 /(^ 1 ) - fi^ 2 )\ ^ \Mi — < €. 

Thus, 

n n 

^ (Mi — m<) Axi < 2) ^ ~ *“ 

*-i »-i 

Since €(6 — a) can be made arbitrarily small, any continuous 
function of x is integrable. 

It is not difficult to see that any function which is continuous 
except for a finite number of ordinary discontinuities is integrable 
also. The points of discontinuity can be enclosed in a finite 
number of intervals, each of which is arbitrarily small, and it 
follows from the discussion just above (and from the fact that 
the number of intervals enclosing the points of discontinuity 
is finite) that 

n 

(Mi - Tre.) AXi 

can be made arbitrarily small. 

If f(x) is integrable then |/(x)l is integrable, since, for any given 
mode of subdivision, the difference S — s for |/(x)| is less than 
or equal to the corresponding difference S — s for /(x). More¬ 
over, if /i(x) 5: f 2 (x), and if both/i and /2 are integrable in (a, 6), 
then 

dx > j^f 2 (x) dx, if 5 > a. 
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Note that the difference 

s /i(x) - ft{x) k 0, 

and that <p{x) is integrable since both fi{x) and fiix) are. Then 

dx ^ 0 . 

Thus 

dx - fy 2 ix) dx ^ 0, 
which proves the assertion. 

It may be remarked, in conclusion, that more general defini¬ 
tions of the integral have been given by Lebesgue, Stieltjes, 
Denjoy, and others. The object of all these definitions is to 
include a wider range of functions than those integrable in the 
sense of Riemann. One characteristic feature of all these 
definitions is that if a function satisfies the limitations imposed 
upon it in the treatment of Riemann, then the other integrals 
lead to the same value as the integral of Riemann. 

Since only Riemannian integrals are used in this book, the 
term integrable function will be used henceforth to mean function 
integrable in the sense of Riemann. It should be observed that 
the integrable function, as defined above, is necessarily bounded. 
Some writers include in the class of integrable functions those 
unbounded functions whose improper integrals exist. The 
subject of Improper Integrals is treated in Chap. X. 

36. Direct Evaluation of Integrals. The definition of the 
Riemann integral of f{x) can be applied to calculate the value 
of the integral of any integrable function, but it will be seen from 
the examples given below that the problem of evaluating an 
integral directly from the definition is likely to be quite vexing. 
In fact, one rarely uses mathematical definitions for purposes 
of calculation,* and a powerful theorem known as the funda¬ 
mental theorem of the integral calculus (established in Sec. 38) 
enables one to calculate easily the integrals of a large number 
of continuous functions. However, the concept of the definite 
integral as the limit of the sum is so important that it seems 

* The reader will recall that he seldom uses the definition of the derivative 
in calculating the derivatives of specific functions. Instead, he develops a 
set of formulas based on the definition. 



$36 


DEFINITE INTEGRALS 


111 


desirable to apply the definition to the calculation of the integrals 
of some simple functions before the fundamental theorem is 
discussed. The reason for dignifying this theorem with the 
adjective fundamental will be apparent when the same problems 
are solved with its aid. 



Consider the function 

f{x) = where 


0 < X < 1. 


Since x^ is continuous, one is assured that the limit of the sum 


n 


Axi exist^nd is independent of the choice of the fc a nd 

1-1 


of the mode of subdivision of the interval (0, 1) into n parts. 
Thus, to make the problem easier, let the interval (0,1) be divided 

into n equal parts so that Ax* = ^ (Fig. 24). The points of 


subdivision xo, Xi, X 2 , • • • , are 


n 1 2 n - 1 , 

Xo = 0, Xi = X2 = ->••• , Xn-1 = --- y Xn = 1. 

n n n 

If the points be chosen as the right end points of the intervals 
Ax» = x» — Zi^if there results 
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dx = ^/({«) 

.i+(?y.i+... +(niiiyi+p.ii 

n \n/ n \ n / n n] 


= Um ii±2^+ii±- 


Now the sum of the terms in the numerator is given by the 
formula* ^-- 


12 + 22 + 32 + 


fn(n + l)(2n + 1) \ 
6 


Substituting this in the right-hand meinH^ of the foregoing 
expression gives 

Jo n-.« 6n» 




The reader will find it instructive to carry out the calculation 
in this example by choosing Aa;< = - and = (i — Si) Azi, 

Tt 

where 0 ^ ^ 1, (t = 1, 2, • • • , n). The Oi need not be 

equal. Of course, the limit should be the same for an arbitrary 
choice of the points 

Another example of a direct calculation of the integral may 
prove instructive. Let it be required to evaluate the integral 




If the interval (0, z) is divided into n equal parts, so that 


Azi ^ Zi — Xi—1 = — s A, 


* The reader will have no difficulty in proving this assertion by mathe¬ 
matical induction. 
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and if is chosen to be equal to Xi-i (Fig. 25), then 


<-l 

= /i[l + + • • • + 

Calculating the sum of the n terms of the geometrical progression 
appearing in the bracket gives 


— 1 . .V h 

Sn — h— 7" — (c* 1) 


- 1 


— 1 



since nh == x. 


gives 


Letting A 0 and noting that 



PROBLEM 


Evaluate directly from the definition 


X dx. 


37. Mean-value Theorems for Integrals. 

Theorem 1 (First Mean-value Theorem for Integrals). Let 

fix) and ^(x) be two functions which are continuous in the interval 
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(a, b) and suppose that <p(x) does not change sign in this interval. 
Then there exists at least one value (, where a ^ ( :S, b, such that 

fy(x)v>(x) dx = dx. 

In order to prove this theorem, consider 

£{M - f{x)h{x) dx, 

in which M stands for the maximum value of /(x) in (a, 6). 
Let it be supposed that <p{x) ^ 0; then, since M ^ /(x), it follows 
that* 

£[M - fix)]v(x) dx S: 0, 

or that 

(37-1) M^^ix) dx ^ jy{x)tp(x) dx. 

Similarly, if m represents the minimum value of f{x) in (a, b), 
it is seen that 

(37-2) jyix)<p(x) dx ^ dx. 

It follows from (37-1) and (37-2) that 

fy(x)<p(x) dx = dx, 

in which m ^ n ^ M. But /(x) is continuous and hence there 
exists some value { between a and 6, for which/({) = There¬ 
fore 

(37-3) jyix)(fi(x) dx = /(f)^V(*) dx. 

In case <p(x) — 1, (37-3) reduces to 

jy(x) dx = /({)(6 - a), 

a form which is already familiar from elementary calculus. 

This first mean-value theorem expresses the integral in terms of 
the value of one of the functions at a point intermediate between 

* If ^(x) 0, it is m^ly necessary to reverse the inequalities. 
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a £ind 6. Another mean-value theorem for integrals uses the 
intermediate value in the limits. This second theorem requires 
the definition of functions which are monotone increasing or 
monotone decreasing. A function ip{x) is said to be monotone 
increasing in the interval (a, 6), if <p{x^ > <p(xi) for X 2 > Xx, for 
all values of Xi and X 2 in (a, b). It is said to be monotone decrease 
ing, if (p{x^ < <p(xi) for X 2 > Xi,for all values of Xx and X 2 in (a, 6). 

Theorem 2 (Second Mean-value Theorem for Integrals). Let 
f{x) and ip{x) be two functions which are continuous in (a, b). 
If <p{x) is a positive monotone-decreasing function, then there exists 
a value where a ^ ^ ^ b, such that 

jy(x)<p{x) dx = <p(a)jy{x) dx. 

If tp{x) is a positive monotone-increasing function in (a, 6), then 
there exists a value where a < { < b, such that 

fyix)<fi(x) dx = <p(b)£fix) dx. 

If <p(x) is either monotone increasing or monotone decreasing but not 
necessarily always positive, then 

fyix)<p(x) dx = <p{a)jy(x) dx + <p(b) dx. 

The proof of the first part of the theorem depends upon the 
fact that 

n 

dx = lira - Xi-i), Xi_i ^ ^ x<, 

in which the interval (a, b) has been divided into n parts by the 
points Xi in such a way that 

a ^ Xo < Xx < X2 • • • < Xn-l < Xn ^ b. 

Now consider the expressions 

r 

Sr = ^/(?i)(a:< - r = 1, 2, • • • , n, 

and let M represent the largest and m represent the smallest of 
these expressions. Then, since 

/(€i)(^i ^o) = Si 

and 

/(fe)(®j ““ i) ^ ““ ~ 2, 3j • ' • , n, 
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it follows that 

n n 

~ ®»-i) “ <®(€»)si + — Si-i) 

<-l i-2 

n —1 

(37-4) = ]^Si[^(ft) — ^({»+l)] + ^({n)»n. 

But <p(x) is a positive monotone-decreasing function, so that each 
expression is nonnegative, as is ^(fn). Hence the 

right-hand member of (37-4) is not less than 

n —1 

— ^({i+i)] + m<p{^n) = ^^(Ji), 
and it is not greater than 

n-l 

^M[ip(^i) — ^(ft+l)] + Mip(^n) = Af^(ti). 

Therefore, 

n 

$-1 

As n is increased so that each of the differences x< — x<_i 
approaches zero, approaches a. Moreover, since m and M are 
the smallest and greatest of the expressions 

r 

Sr = X^i^iKXi - Xi_i), 

it is seen that, as n is increased, m and M approach, respectively, 
the miniTniim and maximum values in and M of dx, where 

1 } takes all values from a to 6. Hence, 

fiitpifi) S! <?(*)/(*) dx ^ 

and 

£<p{.x)f(x) dx = 

in which M ^ li ^ M. But /(x) is continuous and therefore* 
•SeeSec. 38. 
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there must be some value ( for which ju = follows 

that 

(37-5) f\ix)f{x) dx = <p{a)fy(x) dx, a J b. 

Similarly, if ip{x) is a positive monotone-increasing function, 
it can be shown that 

(37-6) £v{x)f{x) dx = vQ))£f(x) dx, a i ^ b. 

For the third part of the proof, suppose that (p{x) is a mono¬ 
tone-increasing function. Then define ^(x) by 

^(x) = ip(b) - ip{x) 

so that ^(x) is a positive monotone-decreasing function in (a, 6). 
Hence, 

j^S{x)^{x) dx = ^{a)^^f{x) dx 

= [^(6) - vj(o)] j^ix) dx. 


Hence, 


jy(x)^(x) dx = - v{x)] dx 

~ £f^^)'p{x) dx. 


£Kx)<p{x) dx = <p(j3)£f{x) dx - v(b)j‘y(x) dx + <pia)J^^f(x) dx, 


dx = <t>{b)j‘^fix) dx -f <p{fl)j^f{x) dx. 

The same result can be obtained in the case where ^(x) is a 
monotone-decreasing function by the use of the auxiliary function 

^(x) = <p{x) - ^(b). 

As an example of the application of the first mean-value 
theorem for integrals, consider the problem of establishing the 
bounds for the elliptic integral 


\/(l - - k^x^) 


where fc* < 1. 
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It follomi fi'Oiu the foregoing that 


X 


^_ 

V(1 - a:*)(l - k*x^) 


1 dx 

Vi - Vi - *** 


where 0 ^ ^ But 


Hence, 


dx 

Jo VI - ** 



T 


6 



_dx_ 

V(1 - a:")(l - 


T 1 

6 Vl - fc2{2‘ 


Replacing { by zero and one-half gives a lower and an upper 
bound for the value of the elliptic integral. Thus, 


IT ^ _dx_ ^ IT 1 _ 

6 Jo a/( 1 6 Vl - 


38. Fundamental Theorem of the Integral Calculus. Consider 
an integrable function /(x) defined in the interval a x 6. 
It is clear that if x is any point of the interval, then 

j;v(x) dx 

exists, and its magnitude depends on the value assigned to the 
upper limit. Thus, for a fixed lower limit, the definite integral 
is a function of the upper limit, and it will be designated by F(x), 
so that 


F(x) = J[V(») dx. 

In order to avoid confusion between the letter x denoting the 
variable of integration and the same letter used to denote the 
upper limit, the integral will be written as 

Fix) = fjm dt. 

Let X + A be some point of the interval (a, b), then 

Fix +h)«jr“^V(o <u, 
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and 

Fix + h) - Fix) = dt - J[7(0 dt 

Combining^ thje integrals in the right-hand member of this expres¬ 
sion givea 

(38-1) Fix + h) - Fix) = dt. 

An important deduction can be drawn immediately from (38-1). 
Since 


lim f^^'^fit) dt = 0, 

h —*0 •'* 

it follows that 

Urn [F(x + h) - F{x)] = 0 
*-♦0 

80 ihai F(x) is a continuous function whenever f{x) is an integrable 
function. Furthermore, if f(x) is a continuous function in the 
closed interval (a, 6), then the application to (38-1) of the first 
mean-value theorem for integrals gives 

F(x + h)-F(x) 

where t lies between x and x + h. 

Then 


(38-2) 


dx 


lim 

h-^O 


Fix + A) - Fix) 
h 


= lim/({) = fix). 

k-^0 


Now any function Fix) whose derivative is equal to fix) is 
called a primitive of fix), or an indefinite integral of fix). Thus 
the statement embodied in (38-2) gives an important theorem. 

Theorem. The definite integral, regarded as a function of the 
upper limit, is a primitive of the integrand whenever the loiter is a 
continuous function. 

If Gix) is any primitive of fix), then it differs from Fix) at 
most by a ponstant, since the derivatives of Gix) and Fix) are 
equal.* 

* See Sec. 20, p. 63. 
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Q{x) = F{z) + C, 
or 

©(*) = J[7(*) dx + c. 

Setting the upper limit of the integral equal to a gives 

G{a) = C, 

since r '/(x) dz == 0, 

Consequently, 

(38^) JTVW da: = G{x) - G{a), 

where G{x) is any primitive. 

Equation (38-3) is the symbolic statement of the following 
theorem: 

Fundamental Theorem of Integral Calculus. If f{z) is con-^ 
tinuous in the interval a ^ x and G{x) is a function such 

that ^ = /(x) for all values of z in this interval^ then 
£six) dx = G{h) - G(o). 

In the first example of Sec. 36 it was shown directly from 
the definition of the definite integral as the limit of the sum that 

^Vdx = M. 

x’ 

Since a primitive of x^ is it follows from the fundamental 
theorem that 



Again 

Jf'e-d* - e*|; = - 1, 

which agrees with the result obtained in Sec. 36 by a different 
method. 
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The symbol J/(x) dx is used to denote an indefinite integral 

of /(x). The reader will deduce the following properties of 
indefinite integrals: 

(o) d J/(x) dx = fix) dx; 

Q>) Jcfix) dx = 

(c) flMx) +/s(*)l dx = Jfiix) dx + Jfiix) dx. 

39. Differentiation under the Integral Sign. Conmder the 
definite integral 

in which the integrand is a function of a parameter a (as well as 
of x) and the limits are also functions of a. This integral is a 
function of a, and not of the variable of integration x. It 
is frequently desired to obtain the derivative of (39-1) with 
respect to a in cases in which it is inconvenient or impossible to 
express the indefinite integral in explicit form. For this reason 
the following theorem is of great value. 

Theorem. Let 


cffix) dx, where c is a constant; 


where Uo and Ui are differentiable functions in a closed interval {oo, 
a\); f{x, a) and fa(x, a) are continuous in the region ao ^ a S ai, 
Uo(a) ^ X ^ Ui(a). Then 


dip 

da 


relict) 
J uo(a) 


y(x, a) 
da 


dx - fiu„ a)^+fiuu a)^- 


In order to prove this theorem, first form 


= ^(a + Aa) — ip{a). 

Then 


= « + A«) dx + « + A«) dx 

+ « + A«) dx - a) dx 



122 ADVANCED CAICULUS fN 

TIm first integral tbe first expresskm has been -written aa the 
Bom vH the first three integrals of the second eiqireBrioa. If the 
second and fourth integrals are combined, one «ui write 


r 

J. 






^Jjx.cc-IrScti 


7 


^/(x, g -f Att) 


By the meaiiHFalrte theorem of tfce differential calculus"** 
f{x, a + Aa) — f {Xj a) = Aa • /«(x, tf)^ a < s| < « + Aol 
Also, by the first mean-value theorem for integrals, 

Aa Aa ^ ' 

= /(So, a + A«)[ ^o(a + Aa) - «,(«) j 

where Wo(a) fo ^ Wo(a + Aa); and, similarly, 

a + Aa) J Ui(a + A«) - Mx(«)l 


dx = f((i, a + Aa) 


where Wi(a) ^ Wi(a + Aa). 

Therefore, 

A^ r“‘^“^d/(a:, ij) , . Amo . ... . . . Aui 

^ ~ Ju.M A^ Air 


a < 17 < a + Aa, Wo(a) ^ fo ^ Wo(a + Aa), 
Wi(a) ^ (1 ^ Ui(a + Aa). 


Hence 


In case the limits Uo(a) and Ui(a) are constants, say Xo and Xi, 
(39-2) reduces to 


* See Sec. 20. 
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Example 1. Formula (39-3) is frequently used for evaluating 
definite integrals.Thus, if 


then 


«>(«) -£log(l+acosx)dx, 

<p’{a) = r ^ - dx = -V{l- -) dx 

Jo 1 + a COS X ajo \ 1 + a COS xj 

1/ , 1 . , a + cos X NU 

= -{ X H- : Sm~‘ -j- ) 

Vl - a* 1 4- a cos xyja 

ir , 1 /. ,a- 1 . _,a + l\-\ 

al_ ■\/1 — a* \ 1 “ ^ J 

= \ = Z - ^ 

a \ "v/1 — a*/ a ay /1 — ot* 


Therefore, 


-w -'J (s - ^ 

= TT^log a -t- log - —^ + 


or 


^(a) = TT log (1 + \/l — a^) + C. 
But, when a = 0, 

V?(0) = log 1 dx = 0. 


Hence, 


and 


0 = TT log 2 c and c = —ir log 2, 


K.) - - log ( ‘ + 


2 

j ^2a 

Example 2. Find if <p{a) = J e “* dx. 


Then 


J 2« Ore* 

“* dx + 2ac““* + 26“^. 

-a» a® 


* See also Sec. 97. 
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ntOBLBMS 

1. Find if ip(a) = j (1 — a cos *)* dx. 

da Jo 

2. Find if ^(a) *» ( tan“‘ dx. 

da Jo a* 

3. Find if ^(a) * | tan (x — a) dx. 

da Jo 

4 . Find if ^(x) = f \/x dx. 

cte Jo 

6. Differentiate under the sign and thus evaluate 

What is the permissible range of values of a? 

6. Differentiate under the si^ and thus evaluate 



cos x)~* dx by using (a 


7. Show that 


cos x)“^ dx — ir(a* — 1)“^, a* > 1. 


(1 — 2a cos X + a*) dx = 0, if 

= T log a\ if 

8. Verify that 


iX 


/(a) sin k(x ^ a) da 


is a solution of the differential equation 




where is a constant. 


a* ^ 1, 
a* ^ 1 . 


40. Change of Variable. In perfomoing the evaluation of the 
definite integral with the aid of the fundamental theorem, it is 
frequently desirable to change the variable of integration in the 


integral dz by means of some relation x » w(0> 


In order to 


emphanze the need of caution, observe the following example of a 



DEFINITE INTEGRALS 


§40 


125 


purely formal change of variable which leads to a nonsensical 
result. 

The integral 



2 

3 ' 


Now, let it be supposed that the variable x is replaced by another 
variable t connected with x by means of the relation 


t = x^. 


The limit in the resulting integral, corresponding to x = —1, is 

t = (-1)2 = 1 
and the upper limit becomes 

t = (1)2 = 1. 

Thus, in the transformed integral the upper and lower limits are 
each equal to unity, so that the value of the transformed integral 
appears to be zero. The difficulty here lies in the fact that the 
function x = <p{t) is not a single-valued function. 

Theorem. Let fix) he a continuous and single-valued function of 
X in the closed interval (a, h) and let x = (pit) he a continuous, 
single-valued function of t possessing a continuous derivative in 
the closed interval ia, ff), where (pia) = a and (piP) = 6. Then 

dx = dt. 

In order to prove this theorem, consider the integrals 


(40-1) Fix) = f^fi^) ^ and 4»(0 = J^f[fpit)Wit) dt. 

By hypothesis x = (pit), so that Fix) is a function of t whose 
derivative with respect to t is 

dFjx) ^ dFjx) ^ 
dt dx dt 


But 


= fix), since fix) is continuous, so that 
% - where ^'(0 = ~ 
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On the other hand, the derivative of #(<) is 

since the integrand of is continuous.* 

The derivatives of F and with respect to t being equal, the 
functions F and ^ can differ only by a constant. But for < = a, 
X = ^(a) = a, so that 

F{x)t^ = F{a) = 0. 

Moreover, 

$(a) = 0. 

Thus the functions F{x) and are equal for t = a, and conse¬ 
quently, they are equal for all values of t in the interval (a, j3). 
Setting t = in the second of the integrals (40-1) and 

X = = b 

in the first integral gives the desired result 

£f(x)dx = f^f[vit)w it) dt. 

Example. Consider If a: = sin t, then 

dx = cos t dt. 

When a; = 0, ^ = 0 and when x = 1, ^ so that 




sin^ t dost dt 


-r 


cos* t dt 


T 

4‘ 


PROBLEM 

Justify the substitution dx = (p'it) dt in the indefinite integral 
^fix) dx to obtain the indefinite integral dt. 


41. Applications of Definite Integrals. The reader is familiar 
with the derivation of the formulas for areas bounded by curves, 
* See Theorems 1 and 2, Sec. 12, 
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for volumes and surfaces of revolution, and for the length of arc 
of a curve. These formulas are given below for reference, and 
in the light of the meaning of the definite integral stated in Sec. 
35, it is best to regard them as the definitions of the geometrical 
entities under consideration. 

The outline of the procedure employed in defining the length 
of arc of a curve is as follows. Assume that the equation of a 
continuous curve C is given in a parametric form as 

f4i-n I® ^ 

^ ^ a^t^b. 

Let it be required to find the length of arc of C between the points 
corresponding to the values of the parameter t = a and t = b. 
Divide the interval a ^ t ^ b into n subintervals of lengths 
Atiy At 2 , •••, Atn by inserting w — 1 points of subdivision 
chosen so that 


€t — to ti ^ ^2 * * * ^ — 5 . 

Denote the increments of the functions in (41-1), corresponding 
to Ati, At 2 , • • • , A^n, by Azi, Ax 2 , • • • , Azn, and Ayi, Ay 2 , 
• • • , Aj/n. 

The sum of the lengths of the chords AC< joining the consecutive 
points on the curve C which correspond to the values of the 
parameter t = ti, (t = 1, 2, • • • , n), is 


«»= 

where 

ACi s V (Axiy + (Ay»)*- 

If the limit of the sum Sn exists* as the number of subdivisions 
is increased indefinitely in such a way that each AU —> 0, then 
this limit is called the length of arc of the curve between the 
points corresponding to the values of the parameter ^ = a 
and t ^ b. 

To ensure the existence of this limit, it is not sufficient to 
require merely that ipi{t) and ^>2(0 be continuous. It is sufficient, 
however, to assume the continuity of the derivatives of (pi(t) 

* Of course, this limit must be independent of the mode of subdivision. 
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and (p»(t) in the interval (a, b). In this event the length « of 
the curve is given by the formula 

The volume of the solid of revolution which is generated by 
revolving a continuous curve y = f(x) about the a:-axis, and 
which is bounded by the planes x — Xi and x — X 2 can be calcu¬ 
lated from 

V = rWdx. 

Jxi 

The surface of revolution of the same solid is 

In the case of the surface of revolution it is sufficient to demand 
the continuity of the derivative of y = f{x), so that the integrand 
will be a continuous function. 

Example 1. Consider the problem of determining the length 
of arc of the logarithmic spiral whose equation is 

p = 

The element of arc length in polar coordinates is given by 

ds = y/ {dpY + (p dey, 

so that 


= a- 


«* + 1 d® 


n 


-(c»» - 1). 


Example 2. Mnd the length of the lemniscate p* = a* cos 29. 
Now p = ay/ COB 20, and therefore, 

^ — g sin 2g 
d9 y/coa 20 



$41 

Hence, 
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' - *^£4 


sin^ 2 $ 
cos 2 $ 

do 


+ cos 26 do 


Setting 26 = X gives 


Vcos 26 
^ dx 




vcosx 


and the substitution of cos <p = \/cos x gives 


8 = 


2\/2aJ* 


dip 


oVi-H 


sin* ip 


This integral cannot be evaluated in^ a closed form with the 
aid of the elementary functions. It is the standard form of the 
elliptic integral of the first kind, which can be evaluated either 
in infinite series (see Sec. 86) or with the aid of the tables of 
elliptic integrals. 


PROBLEMS 

1. Find the area bounded by the curve 

2. Find the volume generated by revolving the curve 
about the x-axis. 

8. Find the surface of the solid whose volume is required in Prob. 2. 
4. Find the surface of the ellipsoid of revolution 

+ 4 . = 1 

a* c* 

Ans, S = sin"* e + 2irac\/l — e\ if c > a; 
e 

_ ira*(l — e*). 1 + e , „ ... . 

e 1 — e 

where e is the eccentricity. 

6. Find the surface generated by revolving the cardioid 


about the polar axis. 


p s 2a cos* - 


Ans. •J^x'O*. 



CHAPTER V 
MULTIPLE INTEGRALS 


42. Double Integrals. The definition of the double integral 
is entirely analogous to that given earlier for the simple integral. 

Let f(x, y) be a single-valued bounded function in a closed 
region R (Fig. 26). Let the region R be subdivided in any manner 
into n subregions AJ2i, ARs, • • • , AR„ of areas AAi, AAj, ■ • • , 



AA«. The upper and lower bounds of the function/(x, y) in the 
subregion AR« will be denoted by Mi and mt, respectively. 
Then 

nii AAi ^ /({<, I/O AAi ^ Mi AAi, 

where (£<, vO is any point in the region ARi. Let«» and S„ denote 
the sums 

n n 

8» as ^trii AAi and = ^Mi AAi, 

which clearly depend on the number n of subre^ons and on the 
mode of subdividing the region R into parts. 

If the sums 8» and jS» approach the same limit S when the 
number of subregions is increased indefinitely in such a way that 
each AAi -* 0, then the limit of the sum 

II 

ni) AAi 
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will also be S, sauce 

n n n 

AAi ^ Vi) ^ ^ Mi AAif 

*-i i-i «-i 

for any mode of subdivision and for any choice of the points 
((«) Vi)* This common limit 8 is defined as the double integral 
of f(Xj y) over the region JK, and one writes 

n 

(42-1) rii) LAi = y) dA- 

t — l 

The region R is called the region of integration and corresponds 
to the interval of integration (a, b) in the case of the simple 
integral. The term double integral refers to the dimensionality 
of the region R. 

The existence of the unique limit • 8 is guaranteed if one 
assumes that the function /(x, y) is continuous in the closed 
region R, This is obvious from the geometrical considerations 
of Sec. 44 if one assumes that the function z = /(x, y) is repre¬ 
sented by a surface. The analytical proof makes use of the 
property of the uniform continuity of continuous functions 
/(x, y) defined over a closed region R and is not given here.* 

PROBLEM 

Let M and m be the maximum and the minimum values, respectively, 
of the continuous single-valued function/(x, y) defined over a region R\ 
then 

n n n 

^ ^ AA<. 

Show, from a consideration of this inequality, that 
f/(x,v)dA =Mv)A, 

where ({, rj) Is some point of the region R, whose area is A. This is 
the mean-value theorem for double integrals. 

43. Evaluation of the Double Integral. It will be assumed in 
this section that the function /(x, y) is continuous over a closed 
region R, so that the limit of the sum (42-1) will be independent 
* See the analogous discussion in Sec. 35. 
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of the mode of dividing the region R into the subregions AiZ< 
and also of the choice of the point ({/, nO within the subregion 
ARt. 

The definition given in the preceding section gives no con¬ 
venient means for the evaluation of double integrals. In order 
to evaluate the double integral, it will be ampler to consider first 



x»a Xt Xg 


Xi., Xi 


x„., X’b 


Fio. 27. 


the case in which the region R (Fig. 27) is a rectangle bounded 
by the lines x = a, x = b, y = c, y — d. The extension 
other types of regions will be indicated later. Subdivide 
into mn rectangles by drawing the lines x = Xi, x <=> Xg, ' • ’ , 
X = Xn_i ,V - yi,y = yt, ' ' ‘ ,y - ym-i. Define 

AXi s Xj — Xj_x, 

where xo » a and x» — h, and define 


Ay/ = y/ - y/-i, 

where yo^ e and y» = d. Let ARt/ be the rectangle bounded by 
the lines x » X(_i, x = X(, y = y/^i, y y^. Denote the area of 


So S’ 
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the rectangle which stands in the tth column and the jth 
row, by 

^Aij = Axi Ayj 

and form the sum of the expressions 

where i/y) is any point of ARi,-. This sum is 
(43-1) Vii) ^Vh 

»-»n, i — m 

where the summation symbol ^ signifies that the terms 

»-i, i-i 

appearing under the summation sign can be added in any 
manner whatsoever. 

Suppose that the terms of (43-1) are arranged so that the 
rectangles A/Za are used first; then all the rectangles ^Ri%\ 
then all the rectangles A/Zts; etc. This is equivalent to taking 
the sum of the terms corresponding to the first, second, third, 
etc., rows of rectangles and then adding these sums. Such a 
rearrangement of the terms of the sum permits one to write 
(43-1) as the double sum 

m n 

(43-2) ^ Vii) Ax<J^ 

i-l »-l 

where the expression in the bracket represents the sum of the 
terms corresponding to any fixed value of j. From the definition 
of the ordinary definite integral, the expression appearing in the 
bracket approaches a limit when n —> oo in such a way that each 
Axi —> 0. Hence, one can write 


hm y/(5<y, va) ^Xi = f fix, 77,) dx, 

or 

n 

(43-3) Vv") ~ 

where lim » 0. The latter expression results from the 
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definition of tiie limit, and it mer^ states tiiat for a suffidmitiy 
lai^ n the difference betsreen the sum and the intognl can be 
made as small as detired. 

Now the int^sl 

£jix,ru)dx 

oontiuns as a parameter and hence defines a function of rn, 
say 

(43^) «»(%) Vi)dx. 

Substituting from (43-3) in (43-2) and making use of (43-4) gives 


m n tn 

(43-5) 2) = X 


But 


so that 


i-i <-i 




m 

^ Ayi = j^v>(y)dy 


j-i 


m 

2»>(>Jf) Ay/ = JT p{y) dy H- «, 


where lim « = 0. Thus (43-5) becomes 


i-1 »-i 



Calculating the limit as both m and n tend to infinity gives 


* The reason for the vanishing of lim Ay/ is not entirely obvious. 

n—»sp ^■•1 

Even though c/—► 0 when n—» the index m likewise tends to infinity, 

and it is conceivable that the limit of the sum may be different from zero. 
The fact that this is not the case here can be seen from the following con¬ 
siderations. Let I f{x, nj) dz denote the integral of the function f(x, ti/) 
over the interval Aa^ Then 

y(x, ij/) dx vn) A.T<j ^ jilfi/ — WK/jAaCi, 

where Af,/ and m,/ stand for the maximum and minimum values of the 
function f {x, ij/) in the interval Xi). But 
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HS 


m n 



where the second step is obtained by recalling the definition 
(43-4). The left-hand member of this equation ^ves the double 


integral v) dA, so that 

(43-6) y)dA= y) ^ 


The double integral is, therefore, evaluated by considering 
f{Xf y) as a function of x alone but containing ^ as a parameter, 


sr. fix, fii) dx = Vi) dx. 

Hence, 

fi n 

/(«> Vi) dx — va) “ ^/| 

i-1 


Let «' be the largest of the numbers {Mu — m<,|, (i = 1, 2, • • • , n), 
0 * = 1, 2, • • • , m), then 


Thus 



n 

— m<,j Axi ^ ~~ 


n 

Vi) dx - va) ^ *'(6 - a). 


But, from (43-3), the left-hand member of this expression is precisely the 
numerical value of </, that is. 


|.,1 :S .'(6 - a ). 

Hence, 

m m 

I 5)*' ^*'>1 ^ - «) 2) - a)(c - d). 

;-l y-i 


Since /(x, y) is a continuous function, the difference between the maximum 
and the minimum values of the function in any subregion tends to zero 
as the number of subregions is increased indefinitely, and consequently^ 
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and integrating it between x = a and x = b and then integrating 
the resulting function of y between y = c and y — d. The right- 
hand member of (43-6) is known as an iterated integral^ and 
(43-6) establishes the relation between the double integral over 
the rectangle R and an iterated integral over the same rectangle. 

Similarly, by taking the sum of the terms in each column and 
V i then adding these sums, there results 


(43-7) fj{x,y)dA 


In case (43-7) is used,y(x,jjrjJs^^t 

- considered a s a funct ion of y aloi^ 

^ _ a^ integrafeJlSetween y ~= c and 

^ y = d, ai^ then the res^ 

'lib^of x is ii^e^ated between x ^ a 
and x = b. Either (43-6) of^lS^r) can be used, but one of them 
is'lrequently simpler in the case of a particular function/(x, y). 

Suppose R is not a rectangle but is a region bounded by a 
closed curve C (Fig. 28) which is cut by any line parallel to either 
axis in at most two points. Let Bi and be the points of C 
having the minimum and maxmlum ordinates, and let Ai and Xs 
he the points of C having the minimum and maximum abscissas. 
Let X = <pi(y) be the equation of B 1 A 1 B 2 , and x = ^ 2 (y) be the 
equation of BiA 2 B 2 , Then, in taking the sum of the terms by 
rows and adding these sums, the limits for the first integration 
will be ^ 1 ( 2 /) and ^ 2 ( 2 /), instead of the constants a and 6 . The 
limits for the second integration will be and 182 , in which /3i 
is the 2 /-coordinate of B\ and ^2 is the 2 /-coordinate of JS 2 . Then 
(43-6) is replaced by 

(43-8) y) dA = ^ | 

Similarly, if y = fi(x) is the equation of A\B\At, y = /»(*) is 
the equation of AiBtAt, ai is the abscissa of Ai, and at is the 
abscissa of A», (43-7) is replaced by 

(4M) v)dA- Xr£>. ») <'» 

In case JS is a region bounded by a closed curve C which is out 
in more than two points by some parallel to one of the axes, the 
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¥» 

previous results can be applied to subregions of R whose bounda¬ 
ries satisfy the previous conditions. By adding algebraically 
the integrals over these subregions, the double integral over B 
is obttuned (Fig. 29). 



Example 1. CJompute the value of Ii = fviA where B 
is the region in the first quadrant bounded by the ellipse 


= l (Fig. 30). 
o’ 6* r~i —V 

-Vi : /V-J' 




J i,- 

Using (43-8) and summing first by rows, one finds 

- t _ _ 

^ r’> fb/ |5v'6«-»K 

= J,H 


_ o^* 

“ 3 ■ 

Using (43-9) srields 

.-■v/a*—»• 
1 ^ 1 “ 

I 




db* 
3 ■ 


It may be remarked that the value of Ii is equal to fA, where 
^ is the y-Ksoordinate of the center of gravity of this quadrant of 

the ellipse, and A is its area. Since A = 
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Similarly, by evaluating It 



a^b 


^ _ 3 _ ^ 

A TTOb 

IT 


which is the a;-coordinate of the center of gravity. 

Exam ple 2. Moment of Inertia, It will be recalled that the 
moment of inertia of a particle about an axis is the product of its 
mass by the square of its distance from the axis. If it is desired 
to find the moment of inertia of a plane region about an axis 

perpendicular to the plane of the region, 
the method of Sec. 43 can be applied, 
where /(x, y) is the square of the dis¬ 
tance from the point (x, y) of the region 
to the axis. Then 

M = f^r^dA. 

For example, let it be required to 
find the moment of inertia of the area in 
the first quadrant (Fig. 31), bounded by the parabola y® = 1 — x 
and the coordinate axes, about an axis perpendicular to the xy~ 
plane at (1, 0). The distance from any point P(x, y) to (1, 0) 
is r = \f(x — 1)* + 2 /*. Therefore, 

M l)* + y*ldA. 



Evaluating this integral by means of (43-8), there results 

n l_yi 

[(x-iy + y*]dxdy 





dy = 


44 

106 ’ 



(44 
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44* Geometric Interpretation of the Double Integral* If 

/(x, y) is a continuous and single-valued function defined 
over the region R (Fig. 32) of the x 2 /-plane, then z == f(x, y) 
is the equation of a surface. Let C be the closed curve 
that is the boundary of R. Using 72 as a base, construct 
a cylinder having its elements parallel to the 2 ;-axis. This 
cylinder intersects z = f{x, y) in a curve F, whose projection 



on the xy-plane is C, Denote by S the portion of 2 = f{x, y) 
that is enclosed by F. Let R be subdivided as in Sec. 43 by the 
lines X = x<, (i = 1, 2, • • • , n — 1), andy = i/,-, (j = 1, 2, • • • , 
m — 1). Through each line x = x* pass a plane parallel 
to the 2 / 2 -plane; and through each line y = y, pass a plane 
parallel to the x 2 -plane. The rectangle Ai2</, whose area is 
AAij = Axi Ai/y, will be the base of a rectangular prism of height 
/({<;> ’?*?)» whose volume is approximately equal to the volume 
enclosed between the surface and the xy-plane by the planes 
X = Xi^iy x = Xi,y = yi-i and y = y,-. Then the sum 

t — n, y — m 

(44-1) 2 

gives an approximate value for the volume V of the portion of 
the cylinder enclosed between z = /(x, y) and the x 2 /-plane. As 
n 00 and w. —> oo, the sum (44-1) approaches V, so that 


(44-2) 
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The integral in (44-2) can be evaluated by (43-8) in which the 
prisms are added finit in the x-direction, or by (43-9) in which 
the prisms are added first in the y-direction. 

It should be noted that formulas (43-8) and (43-9) give the 
magnitude of the area of the regi on E if the function/(x, y) =■ 1; 
for the left-hand member becomes ——~ 

f,dA=ff^dxdy, 

which is A. The area A can be evaluated by using 



Example. Find the volume of the tetrahedron bounded by 

X 1/ X 

the plane ~ + r + - — I and the coordinate planes (Fig. 33). 

Qt 0 C 

Here 




If the prisms are summed first in the x-direction, they wUl be 
summed from x = 0 to the line ab, whose equation is 


0^6 


1 . 


Therefore, 


F 
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abc 
6 ‘ 


This result was obtained by using (43-8) for the evaluation of 7, 
but (43-9) could be used equally well. 

PROBLEMS 

1. Evaluate 


(а) 

and describe the regions of integration in (a) and (6). 

2. Verify that + V^) dy dx - + V^) ^ dy, where the 

region 12 is a triangle formed by the lines y = Oy y = x, and x = 1. 

3. Evaluate and describe the regions of integration for 

So 

(c) + »* + y’) dy <^; 

4. Find the areas enclosed by the following pairs of curves: 

(fi) y = x,y = X*; 

(б) y = 2 - a:, = 2(2 - x); 

(c) y =« 4 — X*, y = 4 — 2x; 

(d) y* = 6 - X, y = x + 1; 

(«) y = Vo* - **. y = o - X. 

6. Find by double integration the volume of one of the wedges cut off 
from the cylinder x* H- y* = o* by the planes z — 0 and « = x. 
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6. Find the volume of the solid bounded by the paraboloid 
y* + z* ~ 4x and the plane » * 5. 

Find the volume of the solid bounded by the plane z = 0, the 
surface z * oj* + y* + 2, and the cylinder + y* = 4. 

8. Find the smaller of the areas bounded by y = 2 — x and 
+ y* *= 4. 

2. find the volume bounded by the cylinders y = x*, y* = and 
the i^anes z ~ 0 and z ~ 1. 

10. Find the volume of the solid bounded by the cylinders 
»* + y* =» a* and y* + z* = aK 

11. Find the coordinates of the center of gravity of the area enclosed 
by y * 4 — 0 ?* and y = 4 — 2x. 

12. Find the moments of inertia about the x- and y-axes of the 
smaller of the areas enclosed by y = a -- xandx* + y‘ = 

46. Triple Integrals. The triple integral is defined in a manner 
entirely analogous to the definition of the double integral. 
The function 

/(*. y, 

is to be continuous and single-valued over the region of space R 
enclosed by the surface S. Let B be subdivided into sub- 
regions ARigt. If AViik is the volume of ARijkf the triple integral 
of f{x, y, z) over R is defined by 

(45-1) lim V 

in a way entirely analogous to that given in Sec. 43. 

In order to evaluate the triple integral, R is considered to be 
subdivided by planes parallel to the three coordinate planes and 
the case of the rectangular parallelepiped is treated first. In this 
case 

AVi,k = Axi Ay, Az*. 

By suitably arranging the terms of the sum 

f—n, y-«, p 

^ (■«*) ^k, 

it can be shown, as in Sec. 43, that 

(46-2) y, z) dV = y> *) ^ *• 

By other arran^ments of the terms of the sum, the triple integral 
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can be expressed by means of iterated integrals in which the 
order of integration is any permutation of that given in (45-2). 

If R is not a rectangular parallelepiped, the triple integral 
over R will be evaluated by iterated integrals in which the limits 
for the first two integrations will be functions instead of con¬ 
stants. By extending the method of Sec. 43, it is readily shown 
that 

(45-3) fjix, y, z) dV = V, dx dy dz. 

Similarly the triple integral can be evaluated by interchanging 
the order of integration in the iterated integral and suitably 
choosing the limits. 

The expression (45-3), or the similar expressions obtained by a 
different choice of the order of integration, gives the formula 
for the volume of R in case /(x, y, z) = 1, Therefore, 



Fia. 34. 


In order to clarify the method of evaluating a triple integral 
by means of iterated integrals, consider the calculation of the 
integral ofithe function/(x, y, z) over a region i2, which is bounded 
by a closed surface 8, Let #( 2 ;, y, z) ^ G be the equation of 8 
and denote by V the volume enclosed by S (Fig. 34), The 
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surface S will be assumed to be such that a straight line parallel 
to one of the coordinate axes, say 2 , cuts 8 in not more than two 
points. An extension to more complicated surfaces can be 
made immediately in a manner analogous to that indicated in 
Sec. 43 for double integrals. 

Construct the right cylinder which projects the surface 8 
on the xy-plane. Let C be the curve along which the projecting 
cylinder is tangent to jS, and let the projection of C on the 
xy-plane be the curve C' whose equation is ^(x, y) = 0. The 
curve C divides the surface 8 into two parts. Denote the equa¬ 
tion of the upper part of the surface by 2 = ^ 2 ( 3 ;, y), and that 
of the lower part hy z = (pi(x,y).* Next, divide the volume 
V into elementary volume elements AF in the following way. 
Divide the area enclosed by C', by a series of lines parallel to 
the coordinate axes, into a number of elementary areas, of which 
AAj is typical. Using each of the elements AA/ as a base, 
erect on each element a prism that will cut 8 in A8i and A/S 21 
and divide the portions of the prisms l 3 ring between A8i and 
A8% by a series of planes parallel to the xy-plane. The entire 
volume V is thus divided into elementary volumes AF. The 
element A Ft/ — A^t A A/ is outlined in Fig. 34. 

Now select a point (x, y, z) within each of the volume elements 
AFi/, and form the sum 


The limit of this sum as > 0 defines the integral 
( 45 - 4 ) y> 

The quantity within the brackets is a function of x and y, say 
F(x, y), and the limit of the sum 



as is a double integral over the area bounded by C. 

If it is evaluated by the methods of Sec. 43, there results 

p(z, y, z) iV ~ y, Z) *] * dx. 


* Obvioudy z » ^t(x, y) and z ^i(x, y) are the solutions of the equation 
y, s) 0 for z in terms of x and y. 
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A specific illustration may clarify this matter further. Let 
it be required to determine the volume enclosed by the ellipsoid 

(x - 2)* , (y - 9)» , (z - 16)* , 

1 4 9 “ 

The equations z = ipi(x, y) and z = ^s(x, y) are, in this case, 


* = 16 ± 3V1 - (* - 2)* - - 9)*, 

the upper sign ^ving <pt and the lower giving The equation 
of the curve C' is that of the ellipse zl 


(x - 2)» (y - 9)* _ . 

1 4 “ ’ 


so that 


= 9 - 2Vl - (as - 2)* 


1 ^, = 9 + 2V1 - - 2)* y. _ 

The evaluation of the integrals is 

left as an exercise for the reader, Fio. 35. 

As another illustration, .let it be required to find the moment of 
inertia /, of the solid bounded by the cylinder x* + y* = o* 
and the planes z = 0 and z = & about the x-axis (Fig. 35). 
Assume uniform density <r. The function /(x, y, z) is the square 
of the distance of any point P(x, y, z) from the x-axis. Therefore i 


/(x, y, x) = y* + 2 *. 


Hence, 


I, = J\y* + 2>d7 

=4c r f\yt + 2») (fe rfj, dx 

Jo Jo Jo 


(o* -1- b* — x*)Vo* — ** dx 
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= p, , + 5* _ O* gini g) cos* e de 
o Jo 

= + 6.)I _ ^] . 1^(3.. + 46'). 

PROBLEMS 

1. Evaluate: 


»_ g«+y« 

2. Find by triple integration: 

(а) The volume in the first octant bounded by the coordinate planes 

and the plane a? + 2|/ + = 4. 

(б) The volume of one of the wedgetf cut off from the cylinder 

«* + !/* = a* by the planes 2 = 0 and 2 = x. Am. J^a*. 

(c) The volume enclosed by the cylinder x* + y* = 1 and the 
planes 2 = 0 and 2 = 2 — x. 

(d) The volume enclosed by the cylinders y* = 2 and x* + y* = o*, 

xo^ 

and by the plane 2 = 0. Am. — • 

(e) The volume enclosed by the cylinders y* + 2 * = o* and 

X* + y* = o*. Am. ^%a*. 

(/) The volume enclosed by y* + 22 * = 4x — 8, + z* — 4, and 

X = 0. Am. llx. 

(y) The volume in the first octant bounded by the coordinate 
planes and x + 3y + 22 = 6. 

(A) The volume enclosed by the cylinder x* + y* = 9 and the 
planes 2 = 5 — x and 2 = 0. 

(t) The volume of the cap cut off from y* + 2 * = 4x by the plane 

2 = X. 

8. Find the moments of inertia about the coordinate axes of the solids 
in Prob. 2. 

4 . Find the coordinates of the center of gravity of each of the volumes 
in Prob. 2. 

5« Find by triple integration the moment of inertia of the volume 
of a hemisphere about a diameter. 

6. Find the coordinates of the center of gravity of the volume of the 
solid in Froh. 5. 

7. Find by triple integration the moment of inertia of the volume of 
the cone y* + «* - o*x* about its axis. 
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S. Fbidtlieiiioiiientof inertia of the eone in Prob. 7 about a diameter 
td its base. 

t. Fmd the voluine in the first octant bounded by z ^ x + 1, x ^ 0, 
y « 0, » = 2*, and x* + y* *= 4. 

10. Sind the coordinates of the center of graTity of the volume 
bounded by x = 2(2 — x — y), x = 0, and x = 4 — x* — y*. 


40. CSiange of Variables in a Double Integral. Let the vari¬ 
ables X and y be connected with some other variables u and v 
by means of the relations 


(46-1) 


« =Mx, y), 
.» =Mx, y). 


where the functions entering in (46-1) are continuous and 
possess continuous first partial derivatives with respect to x 
azsd y in some region of the xy-plane. Moreover, assume that 


tf-l/o 



the equations (46-1) can be solved for z and y in terms of u 
and V to yield 


(46-2) 


X = 4n(u, V), 


If u and V are astigned some fixed vahaes, say a® and Vo, the 
equations 

uo = /i(x, y), 

Vo = Mx, y), 

determine two curves which will intersect in a point (xo^ yo)i 
such that 

c 

■*0 = l^o), 

Jfa = •o)* 
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Thus the pair of numbers (uo, vo) determines the point (xo, yo), 
in the a:y-plane (Fig. 36). 

If u and V are assigned a sequence of constant values 

(Ul, Vi), (U2, Vi), (Ui, Vi), • • • , (Un, Vn), • • , 

there will be determined a network of curves that will intersect 
in the i)oints 

(iPi, yO, («*, ya), (3?8, Vb), • • • , (xn, Vn), • • • . 

Corresponding to any point whose rectangular coordinates are 
(x, y) there will be a pair of curves u = const, and v = const., 
which pass through this point. The totality of numbers {u, v) 
defines a curvilinear coordinate system, and the curves them¬ 
selves are called the coordinate lines. 

Thus, if 

u = Vx^ + 

V = tan~^ 

X 

the family of curves u = const, is a family of circles, whereas 
V = const, defines a family of radial lines. The curvilinear 
coordinate system, in this case, is the ordinary polar coordinate 
system (Fig. 37). 



Consider the element of area dA in the curvilinear coordinate 
system (u, v) (Fig. 38) bounded by a quadrilateral P 1 PJP 4 P 9 , 
the boundary of which is formed by the curves 

« fi{x, y), u + dw » /i(x, y); 

v^Mx,y), v+dv^fiix,y). 
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The positive quantities du and dv are assumed to be finite but 
may be chosen as small as desired. 

The rectangular coordinates (xi, yi) of the point Pi can be 
calculated from (46-2). Thus, 


xi = vi(u, v), 
Vi = v). 



Along the boundary PiPj, the coordinate u does not change, so 
that the coordinates (xj, yt) of P* are given by 

xj = <pi{u, V + dv), 
y% — V + dv). 

Similarly, the coordinates of P» and P4 are 

x» - ^i(u -I- du, v), yt = <pt{u du, v); 

Xi = vi(u -|- du, V -f- dv), yi = ^*(w -f- du, v -f- dv). 

It follows from the theorem of the mean that 

** = vi(u, v + dv) = ^ 

yt = » -f- d») = I') + ^ 

Xg = vi(u + du, v) = <pi{u, v) +-^ du, 

yt = <pi(u + du, v) = <f>t(u, v) + ^ du. 

Now the^area dA of the curvilinear quadrilateral PiPtPiP* 
is approximately equal to twice the area of the rectilinear triangle 
PiPiPs, and the approximation can be made as close as desired 
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by taking du and dv sufficiently small. The area of the recti^ 
linear triangle FJPaPs is @^n by the determinant 

Vi 1 

± Vi 1 

y% 1 

where the plus or minus sign is chosen so as to make the area 
positive. 

Substituting the coordinates of the points Pi, P 2 , and P's 
in the determinant gives 



Since the area of the curvilinear quadrilateral is nearly equal to 
twice the area of the triangle, one can write an approximate 
relation 


dA = ±J(Uj v) du dv, 

dipt d<p2 

du du 

J(UyV) s 

dipi d^2 

dv dv 

The determinant J hm mmj uses in mathematics and is 
called th^ functimai determinamt or /ocoftian.t 
Consider next the double integral 

y) dA, 

* The reader, not familiar with the determinantal expression for the area 
of the triangle, will have no difficulty in deducing it from elementary con¬ 
siderations of analytic geometry 
tSeeChapwXlI. 


( 46 ^) 

where 
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over some region R, where /(x, y) is continuous in R. This 
integral may be expressed in terms of the curvilinear coordinates 
(u, v), by substituting for x and y from (46-2) and by making use 
of (46-3). Thus, 

(46-4) 

where 

F{U, V) = f[<Pl{Uy V)y <P2(Uy V)], 

Some question must be raised regarding the legitimacy of 
replacing the exact element of area dA by its approximation 
given by (46-3), but the exact element of area is equal to 

[\J\ + e] du dv, 

where € —^ 0 with du and dv. 

The infinitesimal € may be neglected, since in forming the limit 
of the sum 

y) AA = v)|J| du dv + t^F{Uy v) du dv 

one can choose du and dv so small that e (and, consequently, 
the second term in the right-hand member of the foregoing 
expression) is made as small as desired.* 

Setting /(x, y) in (46-4) equal to unity gives the expression 
for the area of the region i2, namely, 

(46-5) X = Xw du dv. 

In evaluating the double integrals in (46-4) and (46-5) by 
means of iterated integrals, the limits for u and v must be deter¬ 
mined from a consideration of the region i2, as is shown in the 
following example: 

Example. Let it be required to find the moment of inertia of 
the area of the circle (Fig. 39) 

— ax = 0, 

* A more elegant mode of exhibiting the relationship between the elements 
of area in cartesian and curvilinear coordinates is given in the next chapter. 
However, the demonstration given above has the advantage of directness of 
attack on the problem, even though it calls for a justification of the approxi¬ 
mation involved 
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about a diameter of the circla It is convenient to introduce the 
polar coordinates 

X = p cos 0 
y — pain 0, 

BO that the equation of the circle becomea 

p — acoa 0. 



Fio. 39. 

Calculating the determinant J gives 

I cos $ sin $ 


Pi 


80 that 
Therefore, 
I 


—p sin 6 p cos ^1 
dA ^ p dp dd. 


y^dA 


n o COB 9 

► ^ 


p* sin* d p dp do 




a* cos^ B sin* B 


dB 


0 

6 ?* 
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47. Transfomiation of Points. The discussion in Sec. 46 of the 
change of variables in a double integral leading to the formula 

(47-1) dA = \J\dudv, 

is capable of a somewhat different interpretation. The expres¬ 
sion (47-1) represents the element of area in the curvilinear 
coordinates defined by the equations 


(47-2) 


W = Mx, y), 
» =Mx,y), 


where x and y are thought to be the ordinary cartesian coordi¬ 
nates. Now the Eqs. (47-2) can be interpreted as the equations 
of transformation of points from one cartesian coordinate system 
Xj y to another cartesian system w, v. 




Consider some region R in the xy-plane (Fig. 40), and assume 
that the correspondence of points between the uv-plane and 
the x 2 /-plane is one to one. This means that (47-2) can be solved 
uniquely for x and y in terms of u and v to give the inverse 
transformation 

(47-3) /* " 

( 1 / = v). 

Corresponding to any point (x, y) of the region R the equations 
(47-2) determine a pair of numbers (w, »), and conversely, 
equations (47-3) determine a unique pair of numbers (x, y) for 
every point (w, v) in some region B' of the tiv-plane. The 
boundary C of the region R will be mapped into some curve C* 
in the uv-plane which will enclose the region R\ The magnitudes 
of the areas of the regions R and R^ will not be equal in general. 
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The element of area dA in the xjz-plane will be transformed into 
an element of area dA' in the uv-plane, and the ratio of the 
magnitudes of these elements of area is precisely equal to the 
numerical value of the Jacobian. Therefore [see (46-6)], 

(47-4) fj^dydx^ ^J^J\dudv. 


The integral dv gives the area bounded by the curve 

C', and the factor |J1 introduced in the integrand of (47-4) 
takes account of the magnification of the region R produced by 
the transformation (47-2). This point of view is adopted in 
the treatment of the change of variables given in Sec. 60. 


PROBIJSMS 

1. Evaluate dy dx^ where R is the region bounded by the 

circle x* + y* — a\ Use polar coordinates. Ans. ir(l — e”®*). 

2. Find the area outside p = a(l 4* cos $) and inside p — 3a cos $. 

3. Find the coordinates of the center of gravity of the area between 
p » 2 sin 0 and p = 4 sin 6. 

4. Calculate the elements of area in the wv-coordinate systems which 
are related to the cartesian coordinate system xy by means of the 
following equations of transformation: 

(o) X = u + a, y ^ V + b; 

(6) X — au^y = bv; 

(c) X — u cos a — » sin a, 2/ = w sin a + » cos a; 

where a, b, and a are constants. Interpret your results geometrically. 

5* What are the regions of integration in the t^t;-coordinate systems of 
Prob. 4 if the region R in the a;^-plane is the interior of the ellipse 


^ + 
a* 6* 


6. Discuss the curvilinear coordinate system defined by the relations 

X = u + V, 

y ^ u-v; 

and describe the region in the uv-plane corresponding to the square 

® * 1, aP « 2, y « 1, y = 2. 

7. Discuss the curvilinear coordinate system defined by the relations 
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w = X* — y*, 

V = 2xy. 

Sketch the curves u = const, and v = const. 

8« Find the area of the cardioid p = o(l + cos 6) by integrating first 
with respect to 6 and then with respect to p. Check your result by 
calculating the same area by integrating first with respect to p and then 
with respect to 6. 

9. Find by double integration the area bounded by p = 2a cos 2$ by 
integrating first with respect to 0. 

10. Find the center of gravity of one loop of the curve in Prob. 9. 

11. Find the center of gravity of the area which is bounded by one 
loop of the curve p® == 2a* cos 2d and which is exterior to the circle 
p ^ a. 

12. Find the moment of inertia of the area in Prob. 11 about the 
polar axis. 

48. Change of Variables in a Triple Integral. Let the cartesian 
variables x, y, z be connected with the variables u, v, and w by 
means of the relations 

{ « * /i(*, y, 2), 

0 =f 2 ix,y,z), 

w = Mx, y, z). 

Just as in the preceding section, it is assumed that the functions 
Uy Vy and w are continuous together with their first partial 
derivatives in some region R of the xysr-space, and that Eqs. 
(48-1) can be solved for Xy y, and z in terms of w, v, and w. 

If Uy Vy and w are assigned fixed values Uq, vq and Woy then 

{ Wo = Mx, y, z), 

Vq = /*(x, y, z), 

Wo = Mx, y, z). 

The equations (48-2) define three surfaces, two of which intersect 
in a curve, and the third cuts the curve in a point. Thus, a 
triplet of values (uo, t>o, Wo) determines a point in space, and one 
can regard the totality of niunbers («, v, w) as the curvilinear 
coordinates. The surfaces u = const., v = const., and w = const, 
are called the coordinate surfaces. 

The element of volume dV is enclosed by the three pairs of 

coordinate surfaces (Fig. 41) 

€ 

W = Mx, y, z), V = Mx, y, Z), V) = Mx, y, z). 
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li + dtt = /i(x, y, z), V + dv y, z), 

w + dw Mx, y, z), 

where du, dv^ and dw are assumed to be positive constants. 

The calculation leading to the establishment of the formula 
corresponding to (46-3) is entirely analogous to that of Sec. 
46, and all one needs to do is to calculate the volume of a parallele¬ 
piped that is approximately equal to the element of volume 
bounded by the coordinate surfaces 


and 


u = const., 
V = const., 
w = const., 
+ dw = const., 
i; + dt; = const., 

w + dw ^ const. 



If the solutions of (48-1) be denoted by 
X = vi(w, V, w), 

y = v»(«, w), 

z = V, w), 

theathe element of the volume is 

dV » |/i du dv dw, 
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where 

du du 

d(p2 

dv dv * 

d<p2 d<pz 

dw dw 

The Jacobian (48-3) is frequently written in the following 
forms, which indicate explicitly the variables under considera¬ 
tion,* 



Then 

y, 2) dV = ». «») • |■^ ("^") | • du dv dw, 

where 


(48-3) 


•/(«, V, w) 


dipt 

du 

dv 

dipt 

dw 


F{u, V, w) = f[<Pl(u, V, w), ip2(u, V, w), (Pz{u, V, w)]. 

An interpretation of the meaning of the Jacobian, analogous 
to that of Sec. 47, is immediately available if one prefers to think 
of Eqs. (48-1) as defining the transformation of the points of 
the region R into the points of the region R' in a cartesian coordi¬ 
nate system (u, v, w). The results of this and the preceding 
sections can easily be generalized to more than three dimensions. 

49. Spherical and Cylindrical Coordinates. Corresponding 
to the system of polar coordinates in the plane, there are two 
systems of space coordinates which are frequently used in prac¬ 
tical problems. The first of these is the system of spherical, or 
polar, coordinates. Let P(Zf y, z) (Fig. 42) be any point whose 
projection on the a;y-plane is Q{Zj y). Then the spherical 
coordinates of P are p, 6, in which p is the distance OP, <p is the 
angle between OQ and the positive x-axis, and 6 is the angle 

* Another notation commonly used to denote the Jacobian is 
V j ^ djx, y, z) 

dCu, Vf wy 


See Chap. XII 
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between* OP and the positive 2 f-axis. Then, from Fig. 42 it 
is seen that 


X = OQ cos ip — OP cos (90° — S) cos ^ p sin ^ cos 
y = OQ sin ^ = p s^n % sin 
« = p cos 9. 





The element of volume in spherical coordinates can be obtained 
by means of (48-3). Since 



it follows that 
(49-1) 


sin 6 cos ip 

—p sin 6 sin ^ 

p cos 9 cos ip 
—p* sin 9f 

dV = p2 sir 


sin 9 sin ^ 
p sin 9 cos 
p cos 9 sin 

^ dp dip d9. 


cos 9 

ip 0 

ip —p sin 9 


This element of volume is the volume of the solid bounded by the 
two concentric spheres of radii p and p + dp, the two planes 
through the 2 -axis which make angles of ip and tp + dip with the 
a; 2 -plane, and the two cones of revolution whose common axis 
is the 2 -axis and whose vertical angles are 26 and 2(6 + d6). 

The second space system corresponding to polar coordinates 
in the plane is the system of cylindrical coordinates. Any 
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point P{x, y, «), whose projection on the «y-plane is Q (Fig. 43), 
has the cylindrical coordinates p, B, z, where 0 is the angle between 
OQ and the positive x-axis, p is the distance OQ, and z is the 



distance QP, From Fig. 43 it is evident that x = p cos B, 
y = p sin Bf and z — z. Since 


J 



it follows that 


cos B sin 0 0 

-p sin B p cos B 0 
0 0 1 


== Pf 


(49-2) dV = pdpdBdz, 

This element of volume is the volume of the solid bounded by the 
two cylinders whose radii are p and p + dp, the two planes 
through the z-axis which make angles B and B + dB with the 
x 2 -plane, and the two planes parallel to the xy-plane at distances 
z and z + dz. 

Example X ^-coordinate of the center of gravity of 

the solid of uniform density <r lying in the first octant and bounded 
by the three coordinate planes and the sphere x* + y* + = u*- 
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it is necessary to compute integral can be cal¬ 

culated by evaluating the iterated integral 

but it is easier to transform to spherical coordinates. Then, 


xdV = 


- f r^r^>.c 

Jo Jo 4|o 

aV n , 

= "Je Jq ip dip ^ 


p sin ^ cos ip * p^ sin d dp dB dtp 


sin^ 0 cos ip dB dip 


Therefore, 


aV 

l6 3a 

X =-— = 

yg* 8 

6 

Example 2. Let it be required to calculate the moment of 
inertia Ix of the cylinder used in the illustration of Sec. 45 by 
transforming the integral into cylindrical coordinates. Then 

n ra r2r nb 


« (y^ + z^)<rdV 


-'XXT-^+^)r* 


m b 

^ (p* sin* 0 •+• a*)p dz dO dp 
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= «r dp 

60. Surface Integrals. Another important application of 
multiple integrals occurs in defining the area of a surface. The 
surfaces considered in this section are assumed to have two well- 
defined sides. If one draws two oppositely directed normals 
PN and PN* at any point P of a two-sided surface (Fig. 44) 
and allows the point P to move along any path which does not 
cross the edge of the surface, then the direction of the moving 
normal PN can never be made to coincide with that of PN\ 



Fio. 44. Fig. 45. 

There are surfaces that have 6ne side only. Thus a strip 
of paper glued in such a way that the upper side of one end of the 
strip is joined onto the under side of the other end will form a 
one-sided surface (Fig. 45). If two oppositely directed normals 
PN and PN* are drawn at any point P of this surface, then the 
normal PJV, carried along the path PABCP, will eventually 
coincide in direction with PN*, 

Let z = /(x, y) be the equation of a surface S (Fig. 46). The 
function z = /(x, y) is assumed to have continuous first partial 
derivatives with respect to x and y. This implies that a con¬ 
tinuously turning tangent plane is uniquely defined at every 
point of the surface S, 

Let S* be^a portion of S bounded by a closed curve C, and such 
that any line parallel to the 2 ^axis cuts S* in only one point. 
If C* is the projection of C on the xj^-plane, let the region P, 
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of which C' is the boundary, be subdivided by lines parallel to 
the axes into subregions ARi. Through these subdividing lines 
pass planes parallel to the 2 -axis. These planes cut from S' 
small regions ASi of area Atn. Let AAi be the area of ARi. 
Then, except for infinitesimals of higher order, 

AAi = cos AtTif 

where cos a<, cos ft, and cos 7 * represent the direction cosines 



of the normal to S at any point (a;*, 2 ,) of A/SJ. 

Sec. 28) 


cos a*:cos ft:cos 7 * = 

ax 




it follows that 


1 , 


C0S7» = 



Using the positive value for cos 7 ,-, 


Since (see 


Ui = sec 7* A4, = + (g)* + 1 



+ lAAi 


Then 
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is defined as the area of the surface S'. Since this limit is 

f.yliZ) +(S) 

the value of <r is given by 

(50-1) ,.£mcydA.f -H (g)’ -HI dx dy. 

Similarly, by projecting S on the other coordinate planes, it 
can be shown that 

<r = sec a dA = sec p dA, 

The integral of a function ^(x, y, z) over the surface z = /(x, y) 
can now be defined by the equation 

(60-2) y,z)da = 

J J.*' + (I)’ +1 * 

The outline of the reasoning leading to this definition is as 
follows: The surface S' is divided into regions AS< whose areas 
are Ao-^. Let Pt(x,, 2 /<, Zi) be any point in AaSJ and form the sum 

n 

The limit of this sum as n oo, in such a way that every A<r*- —> 0, 
is called the surface integral of ^(x, y, z) over S' and is denoted by 

fg,v(x, y, z) do. 

This integral can be evaluated with the aid of the formula (50-2). 

To ensure the existence of the limit, it is suiSScient to assume 
that the function ^(x, y, z) is continuous and single-valued for 
all points of the surface S', 

Example 1. Find the area of that portion of the surface of 
the cylindfer = a* which lies in the first octant between 

the planes j? = 0 and z — mx (Fig. 47). 
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This surface can be projected on the aje-plane or on the 2 /^plane 
but not on the xy-plane (since any perpendicular to the xy-plane 
which meets the surface of all will lie on the surface). The 
projection on the x 2 ;-plane is the triangle OAB. Hence 


sec pdA. 

JOAB 


sec /3 — 


- 4 - 1 4 - 

\dx) '^\dz) 

(v^y+‘ 



Therefore, 

O’ = dz dx 

= jjamx(a^ — dx = a*m. 

Example 2. Find the surface of the sphere a;® + y® + «* = 
cut off by the cylinder x® — az + j/® =? 0 (Fig. 48). 

From symmetry it is clear that it will suffice to determine the 
surface in the first octant and multiply the result by 4. Now, 

and since z = y'a* — ®* — y*. 
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Thus, the integral becomes 
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^ r* r‘^*“~* * adydx 

Jo Jo Vo* - 35* - J/* 

It is simpler to evaluate this integral by transforming to cylin¬ 



drical coordinates. The equation of the cylinder becomes 
p == a cos and that of the sphere 


Thus, 


z = y/ = y/a^ — p*. 


<r 


T 

^ p coe a p dp de 

Jo Jo Va® — p® 



Example 3. Find the ^-coordinate of the center of gravity of 
one octant of the surface of the sphere x* + y* 2 * = a*. 

Now, 
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PROBLEMS 


1. Find the volume bounded by the cylinder and the sphere of 


Example 2 , page 164. 




2. Find the surface of the cylinder x* + y* = a* cut off by the cylinder 

y* + s* = a*. Ans. 8 a*. 

3. Find the coordinates of the center of gravity of the portion of the 
surface of the sphere cut off by the right-circular cone whose vertex is 


at the center of the sphere. Ana, x == a cos* 

4 . Use cylindrical coordinates to find the moment of inertia of the 
volume of a right-circular cylinder about its axis. Ans, 

6 . Find the moments of inertia of the volume of the ellipsoid 


?! 4 - ?! 
a* 6 * c* 


= 1 


about its axes. Ana, I» = ^ 5060 ( 0 * + &*). 

6 . Kinetic energy T is defined as T = where M is the mass 

and V is the velocity of a particle. If the body is rotating with a constant 
angular velocity show that 

T = pdV ^ 

where p is the density and I is the moment of inertia of the body about 
the axis of rotation. 

7. Find the coordinates of the center of gravity of the area bounded by 
x^ + y^ == a^, X = 0 , and y = 0 . 

8 . Find the moment of inertia of the area of one loop of p* = o* sin 2B 
about an axis perpendicular to its plane at the pole. 

9. (a) Find the expression for dA in terms of u and v, if x = — v) 

and y — uo] 

(J>) Find the expression for dV in terms of w, v, and ii;, if x = a(l — »), 
y * uv{\ — y>)i and z = now, 

10 . Mnd the center of gravity of one of the wedges of uniform density 
cut from the cylinder x* + y* = a* by the planes « = mx and z = — mx. 

11 . Find the volume enclosed by the circular cylinder p « 2 a cos 
the cone « = p, and the plane « = 0 (use cylindrical coordinates). 

12 . Find the center of gravity of the solid of uniform density bounded 

X y z 

by the four planes ^ + 1 , x = 0, y«0, and * « 0 . 

13 . Find the moment of inertia of the solid of uniform density bounded 
by the cylinder x* -f y* « a* and the planes z ^ 0 and z h about the 
a-axis. 
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14. Find, by the method of Sec. 50, the area of the surface of the 
sphere a:* + y* + s* * a* which lies in the first octant. 

16. Prove that 

\*, y/ \«,«'/ 

Hint: Write out the Jacobians and multiply. 

16. Prove that 


\x, v) \f, yj \%, y) 


where u = «(®, y), v = v{x, y), x = x(f, y), and y = y((, y). 



61. Green’s Theorem in Space. An important theorem that 
establishes the connection between the integral over the volume 
and the integral over the surface enclosing the volume is given 
next. This theorem has wide applicability in numerous physical 
problems and is frequently termed the divergence theorem. 

dP dQ 

Theorem. If P(x, y, z), Q(x, y, z), R(x, y, z) and 
OR 

are coniinuoua and single-valued functione in a region T bounded 
by a closed surface S, then 
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jiP cos « + Q C08 /J + B cos 7 ) d<r - d 7 . 

It will be assumed that S (Fig. 49) is cut by any line parallel to 
one of the coordinate axes in at most two points. If /S is not 
such a surface, then T is subdivided into regions each of which 
satisfies this condition, and the extension to more general types 
of regions presents no dijficulty. 

A parallel to the ^-axis may cut S in two points (a;,*, y,-, Zi) and 
(xi, ytj 2i), in which Zi < Zi. Let z = /i(x, y) be the equation 
satisfied by (x<, Zi) and z = /^(a;, y) be the equation satisfied 
by (xiy yi, 2 <). Thus S is divided into two parts: Si, whose equa¬ 
tion is « = /i(x, y) ; and S 2 , whose equation is « = y). Then 

/»«<*■ y, z) cos y d<r, 

taken over the exterior of S, is equal to 

B(x, y, 2 ) cos 7 dff + fgR(x, y, z) cos 7 da, 

taken over the exteriors of the surfaces Si and S 2 . But, from 
(60-2), these surface integrals are equal to double integrals taken 
over the projection T' of T on the xy-plane. Therefore, • 

y,z)coBydff = y,Mx, y)] - R[x, y,fi{x, y)]} dA 

or 

jR{x, y, z) cos 7 d<r = dV. 

Similarly, it can be shown that 

* The negative sign appears the right-hand member of the equation 
because 

COB 71 dfft —cos 71 dffif 
where the subscripts refer to St and Si. 
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and 

y, z) cos /9 At = dV. 

Therefore, 

(51-1) CO® a -1- Q cos /8 + iZ cos 7 ) Ar 

_ r fdP ,dQ ,dR\,^ 

Since cos ada = dy dz, cos cUr = dz dx, and cos y dcr ^ dx dy, 
(51-1) can be written in the form 

(51-2) ^ dy dz Q dz dx R dx dy) 

^ + 0 + ll) 

The formula (51-2) bears the name of Green.* 

Example. By transforming to a triple integral, evaluate 

/ = J^(x^ dy dz -f- x^ dz dx -f- dx dy), 

where S is the surface bounded by 2 = 0,2 = 6 , and -h y* = a*. 

Calculating the right-hand member with the aid of (51-2) 
and making use of the symmetry, one finds 

I = + X* -f- x^) dz dy dx 

= 4 • a* — X* dx 

= ^ira*b. 

A direct calculation of the integral I may prove to be instructive. 
The evaluation of the integral can be carried out by calculating 
the sum of the integrals evaluated over the projections of the sur¬ 
face S on the coordinate planes. Thus, 

I = - y*)* dz dy - - y*)* dz dy 

+ o* — X* dzdx ” Vo* — »*) dz dx 

+ (*“ f^ °*~** (a*—v*) bdx dy— /*“ (a*—y*) ’Odxdy, 

*The names of Gauss and Ostrogradsky are also associated with this 
theorem. 
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which upon evaluation is seen to check with the result obtained 
above. It should be noted that the angles a, p, y are made by 
the exterior normal with the positive direction of the coordinate 
axes. 

62. Symmetrical Form of Green’s Theorem. One of the most 
widely used formulas in the applications of analysis to a great 
variety of problems is a form of Green’s theorem obtained by 
setting 

p-„_, B-„_ 

in (61-1). The result of the substitution is 


(do , do a , 3t> \ 

„|^_cos« + ^cos/J + -costJ 

r (d^ ,dh>. 


'du dv , du 
\^dx dx dy 


dv , du jTr 


But the direction cosines of the exterior normal n to the surface 


dx - dy 

cos a = cos P — 

an an 

so that the foregoing integral reads 
(52-1) 


cos 7 = 


Jt\P^ 


. du dv . du 
^ dy dy^ dz 




where 


dh , dH , d^v 
^ ^ dy* 


Interchanging the roles of u and v in (52-1) and subtracting the 
result from (52-1) give the desired formula 

X(“ ^ ■ /r<“ 
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A reference to the conditions imposed upon P, Qy and R in 
the theorem of Sec. 51 shows that in order to ensure the validity 
of this formula, it is sufficient to require the continuity of the 
functions u and v and their first and second space derivatives 
throughout a closed region T. 


PROBLEMS 

1 . Evaluate, by using Greenes theorem, 


f dz + dz dz + yz dx dy, 


where S is the surface «* + 2 /* + 2 * = a*. 

2 . Show from geometrical considerations that the angle dS subtended 
at the origin by an element ds of a plane curve C is 


djd = cos(n, r) —> 

where r is the radius vector of the curve, and (n, r) is the angle between 
the radius vector and the normal to the curve. Hence, show that 


J ^cos (n, r) ds r 1 dr 
c r 


where the integral is a line integral along the curve C. 

3. A solid angle is defined as the angle subtended at the vertex of a 
cone. The area cut out from a unit sphere by the cone, with its vertex 
at the center, is called the measure of the solid angle. The measure of 
the solid angle is clearly equal to the area cut out by the cone from any 
sphere concentric with the unit sphere divided by the square of the 
radius of this sphere. In a manner analogous to that employed in 
Prob. 2 show that the element of solid angle is 

, cos(n, r) dcr 
do) =- -r- f 


where the angle between the radius vector and the exterior normal to 
the surface S is (n, r). Also show that 


0 ) 




'cos (n, r) da 


r I dr 
Js r* dn ' 


where the integral is extended over the surface S, 
i. By transforming to a triple integral, evaluate 



x^dydz + t^dzdx + z^dxdy, 
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where S is the spherical surface x* + y* + «* * u*. Also attempt to 
calculate this integral directly. 

6 . Set V » 1 in Green’s symmetrical formula and assume that u satis- 

J f* du 

' — dtr if 5 
8 an 


is an arbitrary closed surface? 

6 . The density of a square plate varies directly as the square of the 
distance from one vertex. Find the center of gravity and the moment 
of inertia of the plate about an axis perpendicular to the plate and 
passing through the center of gravity. 

7. Find the volume of a rectangular hole cut through a sphere if a 
diameter of the sphere coincides with the axis of the hole. 

8 . Show that the attraction of a homogeneous sphere at a point 
exterior to the sphere is the same as though all of the mass of the sphere 
were concentrated at the center of the sphere. Assume the inverse 
square law of force. 

9. The Newtonian potential V due to a body T at a point P is defined 

by the equation 7(P) = where dm is the element of mass of the 

body and r is the distance from the point P to the element of mass dm. 
Show that the potential of a homogeneous spherical shell of inner 
radius 6 and outer radius a is 


and 


2 inr(o> - 6»), 

if 

r < 6, 

4 o« - 6* 

if 


r ’ 

r > Oj 


where a is the density. 

10. Find the Newtonian potential on the axis of a homogeneous 
circular cylinder of radius a. 

11 . Show that the force of attraction of a right-circular cone upon a 
point at its vertex is 2T<Th{l — cos a), where h is the altitude of the cone 
and 2a is the angle at the vertex. 

12 . Show that the force of attraction of a homogeneous right-circular 
cylinder upon a point on its axis is 


2 iror[^ + \/ + a* — \/ (P + A)* + o*], 


where h is altitude, a is radius, and R is the distance from the point to 
one base of the cylinder. 

13. Set up the integral representing the part of the surface of the 
sphere x* + y* + «* = 100 intercepted by the planes x = 1 and x — 4. 

14. Find the mass of a sphere whose density varies as the square of 
the distance from the center. 

16. Find the moment of inertia of the sphere in Prob. 14 about a 
diameter. 
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16. A circular hole of radius h is drilled through a sphere of radius a. 
What is the volume drilled out if the axis of the hole coincides with a 
diameter of the sphere? 

17. A circular hole of radius h is drilled through a circular cylinder of 
radius a in such a way that the axis of the hole coincides with a diameter 
of the cross section of the cylinder. What is the volume drilled out? 

18. Set up the integral for the area of the surface of the sphere inter¬ 
cepted by a right-circular cylinder one of whose elements contains a 
diameter of the sphere. Evaluate this integral if the radius of the 
cylinder is equal to one-half the radius of the sphere. 

19. If a sphere is inscribed in a right-circular cylinder, then the 
surfaces of the sphere and the cylinder intercepted by a pair of planes 
perpendicular to the axis of the cylinder are equal in area. Prove it. 



CHAPTER VI 
LINE INTEGRALS 


63. Definition of Line Integral. Consider a continuous curve 
C (Fig. 60) joining the points A and B, whose coordinates are 
(a, b) and (c, d). Let M(xy y) and Nix, y) be two single-valued 

and continuous* functions of x 
and y for all points of C. Divide 
the curve C into n arcs by 
inserting n — 1 points Pi whose 
coordinates are (x,-, j/*), and define 



and 


AX\ —“ Xi Xi-^\ 

^yi ^yi- 


Fio. 60. with i = 1, 2, • • • , n, where 

Xo = a, yo^ b, Xn ^ c, yn ^ d. 
On each of the n arcs choose a point ({»•, iji), and form the sum 


(63-1) ^ 

t-l 

The limit of this sum as n—> oo and every Axi and Ay< tends to 
zero is defined as a line integral along the curve C, or in symbols 

n 

lim V[Af({<, i)i) Axi -f- Ni^i, in) Ay<] 

-fjmT.v) dx + N(x, y) dy]. 


* A function F{x, y) is continuous along the curve C if it is continuous at 
every point of C, The continuity at a point (a;oi yo) of the curve C means 
that lim F{x, y) « F(xo, yo) when the point (x, y) approaches (xo, yo) along 

af-*Xd 

y-*y* 

C, that is, \F(x, y) — F(xo, yo) | < € for all points of the curve C that satisfy 
the inequalities \x — a;o| <17 and \y — yo| < 17. 
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The fact that the limit of the sum exists independently of the 
mode of subdivision and of the choice of the points 
follows directly from the existence of the ordinary definite integral 
if the curve C is assumed to be such that it can be broken up into 
a finite number of monotonic arcs. For, let the equation of the 
curve C be 

y = 

and assume that C is such that a line parallel to either of the 
coordinate axes meets the curve in, at most, one point* (Fig. 61). 



Divide this curve into n arcs by inserting the points of sub¬ 
division Pij (i = 1, 2, • • • , n — 1), the coordinates of which 
satisfy the conditions 

a = Xo < a^i < X2 < • • * < Xn-\ < Xn = c, 

6 = 2/0 < yi < 2/2 < • • ' < 2/n-l < yn = d, 

and form the sum 

n n 

(53-2) iji) Axi — /(^Ol 

t-i <-1 

Since M[x, f{x)] is a continuous function, the limit of the sum 
(63-2) as n —> 00 is precisely the ordinary definite integral, so 
that one can write 




lim Vi) 

n—► • 




f"Mlx, fix)] dx. 


* This is equivalent to saying that the function /(x) is monotone* 
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Denote the inverse oi y — f(x) by x = then a precisely 
similar argument shows that 

n n 

= f^N[<p{y), y] dy. 

Thus the line integral 

y) + JV(x, y) dy] 

can be expressed as the sum of two definite integrals if the curve 
C is continuous and monotone. This discussion can be extended 
in an obvious way if the continuous curve C can be subdivided 
into a finite number of pieces each of which is monotone. 

It is clear from the foregoing that the magnitude of the line 
integral depends, in general, on the choice of the curve C joining 
the points A and B, but it should be noted that the definition 
of the line integral does not require the existence of the derivative 
of/(x). 

If the equation of the curve C is given in a parametric form as 
X = Mt), 

y = ACO, h), 

where fi(t) and /*(<) possess continuous derivatives, one can 
express the line integral (53-3) as a definite integral by sub¬ 
stituting for X and y in terms of t. Thus, 

fjiM(x, y) dx + N(.x, y) dy] 

= + mmjmm dt, 

where U and ti are the values of the parameter t which correspond 
to the coordinates of the end points A and B, 

If the equation of the curve is given in the form y = /(x), 
where f{z) is a continuous function, then dy = f\x) dx, and 
substitution in the line integral (53-3) gives the definite integral 

y) dx + N{x, y) dy] = f‘{M[x,f{x)] -h JV[x,/(x)]/'(x)) dx. 

It follows from the properties of definite integrals that the 
line integral along the curve C from the point A to the point B 
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is the negative of the line integral from B to A along the same 
curve. 

Example 1. Let the points (0, 0) and (1, 1) be connected by 
the line y = x. Let M(x, y) = x — y* and N(,x, y) = 2xy. 
Then the line integral along 2 / = x, 

I - ~ 

becomes, on substitution of y = x, 


J^*[(z — X*) dx + 2a:* da:] = + **) 

If (0, 0) and (1, 1) are connected by the parabola y = x*, I along 
y = X* is 

J[‘[(x - x*) dx + 2x’(2x dx)] = jj‘(x + 3x^) dx = iKo- 
Example 2. Ck)nsider 

P) = 2x* + 4]ey 


and 


y) = 2x* — y*, 

with the curve y = x* connecting the points (1, 1) and (2, 4). 
Then 


dx + N dy) = J^2x* + 4x • x*) dx + f*i2y - y*) dy 

= 13 %. 

Inasmuch as dy — 2x dx, this integral can be written as 

(2x* + 4x*) dx + (2x* — x^)2x dx = 13%. 

If the equation of the parabola in this example is written in a 
parametric form as 

X = «, 

y = <*, il^t^ 2), 

then the integrand of the line integral can be expressed in terms 
of the parameter t. Substituting for x, y, dx, and dy in terms of 
f gives 

dx + fyf dy] = j;’l(2t* + 4t*) 4- (2f* - t*)2t] dt 
“ + «» - 2*-) dt = 13%. 
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The reader will readily verify that the value of this integral 
over a rectilinear path C joining the points (1, 1) and (2, 4) is 
also 13^. In fact, the value of this integral depends only on 
the end points and not upon the curve joining them. The 
reason for this remarkable behavior will appear in Sec. 56. 


probu;ms 

1. Find the value of dx + {x — y) dy] along the following 

( 0 | 0 ) 


curves: 


(a) straight line x ^ y == t; 

(b) parabola x = y — t; 

(c) parabola x = y - 

(d) cubical parabola x y — 


2. Find the 


value 


. r(i.3) 

J(0.0) 


[x^y dx+ {x^ — y’) dy] along (o) y = 3a:*; 


(b) y = 3a;. 

3. Find the value of f ’ (x^ dx + y^ dy) along the curves of Prob. 1 

•r (0,0) 


above. 


4. Find the value of + y^) dx — 2xy dy] along (a) y — x; 

J ( 0 , 0 ) 

(6) X = y*; (c) y = a:*. 

(y sin xdx — X cos y dy) along y = rc. 

( 0 , 0 ) 

j ^(o,0) 

dy + y dx) along the upper half of the 

( —a,0) 


circle x* + y* = a*. 

7. Evaluate the integral of Prob. 6 over the path formed by the lines 
X = — a, !/ = a, X = a. What is the value of this integral if the path 
is a straight line joining the points (—a, 0) and (a, 0)? 

J '*( 0 , 1 ) 

(x* dx + y^ dy) along the path given by 

(IfO) 


X = sin y = cos (. 

9. Evaluate the integral of Prob. 8 if the path is a straight line joining 
(0, 1) and (1, 0). 

10 . What is the value of the integral of Prob. 8 if the path is the curve 
y = 1 - X*? 


64. Area of a Closed Curve. Let C be a continuous closed 
curve which nowhere crosses itself. The equation of such a 
curve, in parametric form, can be given as 


(64-1) 


* = 

V = /*( 0 , 
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where the parameter t varies continuously from some value 
t to to t — ti and the functions fi(t) and fi{t) are continuous 
and single-valued in the interval U ^ t h. Inasmuch as the 
curve is assumed to be closed, the initial and the final points of 
the curve coincide, so that, 

fi(to) = fl(tl)y 

and 

fiito) = f2{tl). 

The statement that the curve C does not cut itself implies 
that there is no other pair of values of the parameter t for which 

/i(0 =/i(^''), 

and 

/2(o =/2(n.. 

A closed curve satisfying the condition stated above will be 
called simple. 

As t varies continuously from to hy the points (x, y) deter¬ 
mined by (54-1) will trace out the curve C in a certain sense. If 
C is described so that a man walk¬ 
ing along the curve in the direction 
of the description has the enclosed 
area always to his left, the curve C 
is said to be described in the positive 
direction, and the enclosed area will 
be considered positive; whereas if C 
is described so that the enclosed 
area is to the right, then C is 
described in the negative direction, 
and the area is regarded as negative. 

Consider at first a simple closed 
curve C such that no line parallel 
to either of the coordinate axes 
intersects C in more than two 
points. Let C be bounded by the lines x ^ at, x = 02 , y — 61 , 
y = 62 , which are tangent to (7 at Ai, A 2 , Si, and S 2 , respec¬ 
tively. Clfearly C cannot be the graph of a single-valued 
function. Therefore, let the equation of A 1 S 1 A 2 be given by 
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Vi — and the equation of A 1 B 2 A 2 by — fi(x)j where 

fi(x) and f 2 {x) are single-valued functions. Then the area 
enclosed by C (Fig. 52) is given by 


(64-2) 

A = r'y.dx - I 


Jai J 

4/as 


or 

(54-3) 

^=-J 

f^dx, 


in which the last integral is to be taken around C in a counter¬ 
clockwise direction. 

Similarly, if Xi = <pi(y) is the equation of B 1 A 1 B 2 and X 2 = ^ 2 ( 2 /) 
is the equation of BiA 2 B 2 \ 

^ dy - r*xi dy 

or 

(64-4) 


Again, the last integral is to be taken around C in a counter¬ 
clockwise direction. It may be 
noted that (54-3) and (54-4) both 
require that the area be to the 
left as C is described if the value 
of A is to be positive. 

By adding (54-3) and (54-4), a 
new formula for A is obtained, 
namely, 



Fio. 63. 


^ (54-5) A =}ij^(-ydx + xdy). 


This formula gives a line-integral 
expression for A. 

To illustrate the application of (54-5), the area between 
(1) ** = 4y and (2) y* = 4a; (Fig. 53) will be determined. 
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A. = dx-^xdy) = dx + x dy) 


+ |r (-ydx + xdy) 
Xj(2) 

■ sX (“T"^ + * • i*’) + UIX-" • I'** + T'**) 

= £ir - = 1® 

24lo 2414 3 ■ 

For convenience the first integral was expressed in terms of x, 
whereas the second integral is simpler in terms of y. 

The restriction that the curve C be such that no line parallel 
to either of the coordinate axes cuts it in more than two points 
can be removed if it is possible to draw a finite number of lines 
connecting pairs of points on C, so that the area enclosed by 
the curve is subdivided into regions each of which is of the type 
considered in the foregoing. This extension is indicated in 
detail in the following section. 

PROBLEMS 

1. Find, by using (54-5), the area of the ellipse x — a cos y = 6 sin 

2. Find, by using (54-5), the area between y* = 9x and y = 3x, 

3. Find, by using (54-5), the area of the hypocycloid of four cusps 
X = a cos* S^y = a sin* 6. 

4 . Find, by using (54-5), the area of the triangle formed by the line 
X + y — a and the coordinate axes. 

6. Find, by using (54-5), the area enclosed by the loop of the strophoid 

1 - - t*) 


66. Green’s Theorem for the Plane. This remarkable theorem 
establishes the connection between a line integral and a double 
integral. 

Theorem. If M{Xy y) and N{Xy y), and ^ are cordinuom, 

dingle-valtied functions over a closed region R, hounded hy the curve 
Cy then 

/ J.(W - ^) ‘''<*1' 
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The double integral is taken over the given region^ and the curve C is 
described in the positive direction. 

The theorem will be proved first for a simple closed curve 
of the type considered in Sec. 54 (see Fig. 52). 

Again let y\ = /i(x) be the equation of AiBiA^ and = f^ix) 
be the equation of A 1 B 2 A 2 . Then 



Similarly, if Xi = <(>\{y) is the equation of B 1 A 1 B 2 and X 2 =* ^ 2 ( 2 /) 
is the equation of BiA^B^^ 




- N{xiy y)] dy 


J *bt . ^61 

iV’(x 2 , y)dy + I N(xi, y) dy^ 

hi Jht 


or 

(56-2) J dx dy = v) 


Therefore, if (55-2) is subtracted from (55-1), 


(56-3) J dxdy = -jlMix, y) dx + N{x, y) dy]. 

It will be observed that setting M = —y and N = x gives the 
formula (64-5). 

Now let the region have any continuous boundary curve C, so 
long as it is possible to draw a finite number of lines which 
divide the region into subregions each of the type considered in 
the first part of this section; that is, the subregions must have 
boundary curves which are cut by any parallel to either of the 
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coordinate axes in at most two points. Such a region R is shown 
in Fig. 64. 

By drawing the lines A 1 A 2 and -48-44, the region R is divided 
into three subregions Ri, R^^ and Bs. The boundary curve of 
each region is of the simple type. The positive direction of 
each boundary curve is indicated by the arrows. The theorem 
can be applied to each subregion separately. When the three 
equations are added, the left-hand members add to give the 



double integral over the entire region R. The right-hand 
members give 

—dx + N dy] — dz + N dy] — dx + N dy], 
where 

Cl = A1B1A2 + A2A1, 

C2 = A1A2 "H A2B2AZ -i- ^ 8^4 + A4A1, 

Cz = A4A8 + AzBzAi, 

Since each of the lines A 1 A 2 and A 8 A 4 is traversed once in each 
direction, the line integrals which arise from them will cancel. 
The remaining line integrals, taken over the arcs of C, add to 
give the line integral over C, Therefore, 

/X(^ - f - -Xw * + « iy) 

holds for regions of the type /2. 
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Another type of region in which an auxiliary line is introduced 
is the region whose boundary is formed by two or more distinct 
curves. Thus, if R (Fig. 55) is the region between Ci and C 2 , the 
line A 1 A 2 is drawn in order to make the total boundary 

C\ + A 2 A 1 + C 2 + A 1 A 2 

a single curve. The theorem can be applied, and the line 
integrals over A^Ai and A 1 A 2 will cancel, leaving only the line 
integrals over Ci and C 2 . 

If the region R is such that any closed curve drawn in it can, 
by a continuous deformation, be shrunk to a point without 
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crossing the boundary of the region, then the latter is called 
simply connected. Thus, regions bounded by a circle, a rectangle, 
or an ellipse are simply connected. The region R exterior to 
Cz and interior to Ci (Fig. 55) is not simply connected because a 
circle drawn within R and enclosing Cz cannot be shrunk to a 
point without crossing C 2 . In ordinary parlance, regions that 
have holes are not simply connected regions; they are called 
multiply connected regions. The importance of this classification 
will appear in the next two sections. 

Example. Evaluate by using Greenes theorem 

dx + y’ dy), 

where C is the closed path formed hy y — x and y* = x^ from 
(0. 0) to (1, 1) (Fig. 56). Since M = rr*y and N = y®. 
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PROBLEMS 

1. Find, by Green’s theorem, the value of 

fj.x^dx -{-ydy) 

along the closed curve C formed by = a? and y — x between (0, 0) 
and (1, 1). 

2. Find, by Greenes theorem, the value of 

-\-y)dx + {x - y*) dy] 

along the closed curve C formed by y^ = x* and y = x between (0, 0) 
and (1, 1). 

3. Use Greenes theorem to find the value of 

Xi<*» — X*) dx + x* 2 / dy] 

along the closed curve C formed by y = 0, x = 1, and y — x, 

4 . Use Greenes theorem to evaluate 

along the closed path formed by y = 1, x == 4, and y = -b V*. 

6. Check the answers of the four preceding problems by evaluating 
the line integrals directly. 


66. Properties of Line Integrals. 

Theorem 1. Let M and N be two functions of x and y, such that 


Af, N, and are continuous and single-valued at every ‘point 


of a simply connected region B. The necessary and sufficient 
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condition that dx + N dy) = 0 around every closed curve 

C drawn in 22, is that 

dM ^ dN^ 
dy dx * 

for every point of 22. 

Since 

- + Nd,). /£(f - f ) 

where A is the region enclosed by C, it follows that 

dM ^ dN 
dy dx 

makes the double integral, and consequently the line integral, 
have the value zero. Conversely, let X<" dx + N dy) = 0 
around every closed curve C drawn in 22. Suppose that 

dy dx ^ ^ 


at some point P of 22. 
tions of X and y, 


Since and ^ are continuous func- 
dy dx 


dM dN 
dy dx 


is also a continuous function of x and y. Therefore, there must 
exist some region S about P, in which ^ has the same 


sign as at P. Then 



dxj 


dx dy ^ 0, 


and txence J{M dx + N dy) 9 ^ 0 around the boundary of this 
region. This contradicts the hypothesis that 


fgiMdx + Ndy) = 0 
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dy 


dx 


at all points of R, 
Example 1. Let 


M = 


- 




and 


N = 


X* + y^ 


Then 


^ ^ ^ ^ y^ - 
dy dx (x^ + y^y 

M, Nj and ^ are continuous 

and single-valued for all points of 
the xy-plane except (0,0). Hence 

X(" dx + N dy) = 0 around any 

closed curve C (Fig. 57) which 
does not enclose (0, 0). In polar coordinates, obtained by the 
change of variables, 

® = p cos 0, y = p sin 



Fig. 67. 


If C does not enclose the origin, d varies along C from its original 
value Sq back to ^o- Therefore, J^dd = 0. If Ci encloses the 

origin, d varies along Ci from do to + 27r, so that f dd = 2 t. 

JCi 

Example 2. Find, by Green's theorem, the value of 


I = + xy)dx + (y* + **) dy], 

where C is the square formed by the lines y = ± 1 and * = ± 1. 
Since 


m 

dy 


= X, 


dN „ 
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Note that the line integral has the value zero, but 

This does not contradict Theorem 1. Why? 

Theorem 2. Let M and N acUisfy the conditions of Theorem 1. 

The necessary and sufficient condition that 

he independent of the curve connecting (a, b) and (x, y) is that 
dN 

at all points of the region R. In this case the line inte-- 
gral is a function of the end points 

^P^y) o^v- 

^ J Suppose Let Ci and 

/ Ct (Fig. 58) be any two curves from 

(A to P, and let 


A(a,b) 


Fio. 68. 


/i ^ fpi dx + N dy) 
h = f{Mdx + Ndy) 


be the values of the line integral from -4 to P along Ci and C2, 
respectively. Then /i — /2 is the value of the integral around 
the closed path formed by C\ and Cz. By Theorem 1, 

Ii — Iz — 0 . 

Therefore, /i = /2, so that the line integral taken over any two 
paths from to P has the same value. 

Conversely, suppose thatJ *{M dx N dy) is independent of 
the path from A to P. Then, for any two curves C\ and C2, 
h = It follows that J*(Af dx-\-N dy) = 0 for the closed path 

formed by C\ and C2. Hence, by Theorem 1, 

^ dy dx 

Example. Consider 

Since —7' ~ ^ ^ both functions are continuous 

ay X* ox X* 

except at (0, 0), the line integral is independent of the path so 
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long as it does not enclose the origin. Choose j/ = 1 from 
(1, 1) to (2, 1), and x = 2 from (2, 1) to (2, 2), as the path of 
integration. Then 




5 ^ 1 | 


- 5 


9 

’ 8 ’ 


Theorem 3. Let M and N aaiisfy the conditions of Theorem 1. 
The necessary and sufficient condition that there exist a function 

F{x, y) such that ^ = M and ^ = N is that ^ at all 

’ dx dy dy dx 

points of the region R. 

If Theorem 2 proves that 

dy dx 


is independent of the path. Therefore, 

( 66 - 1 ) ^ 

and this function F(x, y) depends only on the coordinates of the 
end points of the path. Hence, 

F{x + Ax, y) = 

Let the path of integration be 
chosen as a curve C (Fig. 59) from 
A to P and the straight line 
PP' from P(x, y) toP'(x + Ax, y). 

Then, 

F{x + = C‘'^\Mdx + Ndy)-\- dx N dy) 

J (OiO) J (*.V) 

or 

(56-2) F(x -I- Ax, y) = F{x, y) + fJ'^^Mix, y) dx. 

The second integral reduces to the simpler form given in (56-2) 
ance y is constant along PP', and therefore dy = 0. From (66-2) 
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^ lim I F(x + Ag, y) - F{x, y) 1 
dx Ax J 

Application of the first mean-value theorem* gives 

y) dx = Ax y)y (x ^ ^ ^ x + Ax). 

Therefore, 

- Aa: y)l = y). 

OX A*->oL^^ j a»-»o 

Hence, 

g = M(x,,). 

It can be proved similarly that 

% = Nix,y). 

The function F is really a function of both end points. Multiply- 

qF dF 

ing ^ = Af(x, y) by dx and -^ = N{x, y) by dy gives 

dF = ^dx + ^dy = M{x, y) dx + Nix, y) dy. 

Thus, if 

dy dx’ 

the integrand in dx + N dy) is the exact differential 

of the function Fix, y), which is determined by the formula 
(56-1). 

The most general expression for a function $(*, y), whose 
total differential ia di = M dx + N dy, ia 

9ix, y) = Fix, y) + C, 


•See Sec. 37. 
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where C is an arbitrary constant. Indeed, since dF and 
are equal, 

d{F - $) = 0, 

so that 

F “ ^ const. 

To prove the necessity of the condition of the theorem, note 
that if there exists a function F(x, y) such that 

^ = M(x, y) and = Nix, y). 


aw dM 
dy dx dy 


a^F ^ m 

dx dy dx 


dM .dN , ,, dW , d^F 

Since are both continuous, ^and -r — r- are also 

dy dx dx dy dy dx 

continuous, and hence,* 


Therefore, 


dW _ dW 
dx dy dy dx 

dy dx 


As a corollary to Theorem 3, one can state the following: 
The necessary and sufficient condition that M{x, y) dx + N{x, y) dy 

be an exact differential is that 


PROBLEMS 


1. Show that 


+ y^)dx + 2xy dy] 


is independent of the path, and determine its value. 
2. Test for independence of path: 


(a) /(y cos xdz + siax dy ); 
Q>) J*K** -y*)dx + 2xy dy]; 


^ See Sec. 31. 
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(c) J* [{x — y*)dx + 2xy dy\-, 

(<i) J*[(»* -y'^dx- 2{x - l)y dy]. 

fd-Dfci _ „t) y I 

3. Show that I dx + 7 -—^— ^ dy is independent of 

J 0.0) L(1+a:)‘ (l+x)* J 

the path and find its value. 

4. Show that the line integral 



—ydx 
x^ + y^ 


+ 


xdy 

X* + y^_ 


evaluated along a square 2 units on the side and with center at the origin 
has the value 2ir. Give the reason for failure of this integral to vanish 
along this closed path. 

6. Find the values of the following line integrals: 


(а) 

( б ) 
(c) 


(B) 


rG’s 

J(0,0) 

fi 

X 


(y coaxdx + sin x dy). 

Gi)r 1 

LVi-** J 


[(a: + 1 ) (£c + (» + 1 ) dy]. 


67. Multiply Connected Regions. It was shown that the 
necessary and sufficient condition for the vanishing of the line 

integral y) dx + N(x, y) dy] around the closed path C 

dN 

is the equality of and — at every point of the region enclosed 


by C, It was assumed that C was drawn in a simply connected 
region R and that the functions M{x, y) and N{Zf y), together 
with their first partial derivatives, were continuous on and in 
the interior of C. The latter condition was imposed in order to 
ensure the integrability of the functions involved. The reason 
for imposing the restriction on the connectivity of the region 
essentially lies in the type of regions permitted by Green's 
theorem. 

Thus consider a region B containing one hole (Fig. 60). The 
region R will be assumed to consist of the exterior of C 2 and the 
interior of C . Let a closed contour C be drawn, which lies 
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entirely in R and encloses Cj. Now, even though the functions 
Af(x, y) and y) together with their derivatives may be 

continuous in 72, the integral y) dx + N(Xf y) dy] 

may not vanish. For, let K be any other closed curve lying in R 
and enclosing C 2 , and suppose that the points A and B oi K 
and C be joined by a straight line AB Consider the integrals 

Sapa Sab Sbqb Jba^ 

where the subscripts on the integrals indicate the direction of 
integration along the curves K, C, and along the straight line A By 
as is indicated in Fig. 60. Since the path AB is traversed twice 



Fic. 60 . 


in opposite directions, the second and the last of the integrals 
above will annul each other, so that there will remain only the 
integral along K, traversed in the counterclockwise direction, 
and the integral along C, in the clockwise direction. Now if M 
and N satisfy the conditions of Theorem 1, Sec. 56, then 

f^^[M dx+ N dy] + f^JiM dx + N dy] = 0, 

where the arrows on the circles indicate the direction of integra¬ 
tion. Thus 

(57-1) f^J[M dx + N dy] = f^JM dx + N dy], 

both integrals being taken in the counterclockwise direction. 

The important statement embodied in (57-1) is that the 
magnitude of the line integral evaluated over a closed path in R, 
surrounding the hole, has the same constant value whatever be 
the path enclosing Cf This value need not be zero, as is seen 
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from a simple example already mentioned in Sec. 56. Thus, 
let the region R consist of the exterior of the circle of radius 
unity and with center at the origin and of the interior of a con- 

*— y 

centric circle of radius 3 (Fig. 61). The functions Af = 



Fio. 61 . 


and N = and their derivatives, obviously satisfy the 

+ J/2 

conditions of continuity in R and on Ci and C 2 . Also, 




where C is the circle 


X = a cos B, 

y = a sin d, (1 < o < 3), 

gives 

= 2x. 

Jo a* 

The function F(x, y), of which Af(x, y) dx + N{x, y) dy is 
an exact differential, is F(x, y) — tan~‘ -> which is a multiple- 
valued function. 
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The function 

F(jc, y) = y) dx + N{x, y) dy], 

where M and N satisfy the conditions of Theorem 1, Sec. 56, will be 
single-valued if the region R is simply connected (as is required 
in Theorem 1) but not necessarily so if the region is multiply 
connected. 

68. Line Integrals in Space. The line integral over a space 
curve C is defined in a way entirely analogous to that described 
in Sec. 56. 

Let C be a continuous space curve joining the points A and J?, 
and let P(x, t/, z), Q{x^ 2 ), and R{x^ y, z) be three continuous, 
single-valued functions of the variables x, y, z. Divide the 
curve C into n arcs As, (i = 1, 2, * • • , n), whose projections 
on the coordinate axes are Ax<, Aj/,, A^i, and form the sum 

n 

Vi} f*) 4" Qi^i) Vi} ti) ^Vi "b Vi} f») 

where (^,, rji, f,) is a point chosen at random on the arc As,*. 
The limit of this sum as n increases indefinitely in such a way 
that each As, —> 0 is called the line integral of P dx -f- Q di/ + B dz, 
taken along C between the points A and B. It is denoted by 
the symbol 

(58-1) y, 2 ) dx -f- Qix, y, z) dy -|- R{x, y, z) dz]. 

The conditions imposed upon the functions P, Q, and R are 
sufficient to ensure the existence of the limit, provided that the 
curve C is suitably restricted. 

If the equation of the space curve C is given in parametric 
form as 

(x = fx(t), 

(58-2) <j/=/2(t), 

= Mt), ti), 

where /i(<), /*(0> and /s(<) possess continuous derivatives in the 
interval to ^ t ^ h, the line integral (58-1) can be expressed 
as a definite integral 
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£[p -m + Q -m + B -m] dt 

where P, Q, and R are expressed in terms of t with the aid of 
(58-2). 

69. Stokes’s Theorem. Simply connected regions only will be 
considered in the remainder of this chapter. A simply connected 
space region is characterized by the fact that any closed curve 
drawn in it can be shrunk to a point without crossing the surfaces 
bounding the region. Thus, a cube, a sphere, a cylinder, or a 



region between two concentric spheres are examples of simply 
connected space regions. An anchor ring, or torus, is not simply 
connected. 

In considering closed surfaces, the direction of the exterior 
normal to the surface will be reckoned as positive. If the 
surface is open and two-sided (such as that of a hemisphere, for 
example), the direction of the positive normal may be taken at 
will. Let an open two-sided surface S be bounded by a closed 
curve r (Fig. 62); then the motion along T will be regarded as 
positive if a man walking along F with his head in the direction 
of the positive normal has the surface S to his left. 

Stokes’s Theorem. Let P(x, y, z), Q(x, z), and R(z, z) and 
their partial derivativea with respect to x, y, and z he conlinuoua 
and single-valued functions in a region containing the surface S 
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which is hounded by the closed curve T. Let dS be the element 
of area of S, and let cos a, cos /8, and cos y be the direction cosines 
of the exterior normal to dS, Then 

Jjfdx + Qi!, + S&) - - g) cos . 

. fsp aR\ . , (dQ ap\ 1 

Let z = f(Xj y) be the equation of S and consider 
P(x, y, z) = P[x, y, fix, y)] = M{x, y). 

Let C be the projection of F on the a:i/-plane, so that 

//<»■ y, z) dx = fMix, y) dx. 

From Green’s theorem for the plane, 

where A is the projection of S on the ly-plane. But 


dM dP dPdz 
dy dy dz dy 


so that 




dz dz , „ dz COS jS 

—:-r-: — 1 = cos a: cos 0: cos y, -- 

dx dy dy cosy 


Moreover, 


dxdy = cos y dS. 

Therefore, 

(59-1) jp (*, V, z)dx = j cos ^ ^ cos y j dS. 


* 8ee Sec. 28. 
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Similarly, it can be shown that 

(59-2) dy = j j cos y - H cos dS, 

By adding (69-1), (69-2), and (69-3), 

(5M) J_^(P*. + Qi» + S*) = JJ|(g-f)c«„ 

+ (S - S)+(S - f 

Using the fact that cos a dS = dy dz, cos fi dS = dz dx, and 
cos ydS = dx dy^ (59-4) can be written in the form 

(69-5) j^(Pdx + Qdy + R dz) = J ^ dx dy 

+(f *'*4 

By means of this theorem, it is possible to derive three theorems 
analogous to those given in Sec. 56 for line integrals in the plane. 
Since the proofs of these theorems are similar to those given in 
Sec. 56, they will be omitted here. 

Theorem 1. Let the region of space considered he one in which 
P(x, y, z), Q{Xy y, z), and 12(x, y, z) and their partial derivatives are 
continiLous and single-valued functions of x, y, and z. Then the 
necessary and sufficient condition that 

dx + Q dy R dz) =0 

around every closed curve in the region is that 

dy dx ’ dz dy* dx dz ^ 

for every point of the region. 

Theorem 2. Let the functions considered satisfy the conditions 
of Theorem 1. Then the necessary and sufficient condition that 

+«*+**’ 
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he independent of the path from (a, b, c) to (x, y, z) is that 
dy dx^ dz dy^ dx dz^ 


for every point of the region. 

Theorem 3. Let the functions P, Q, and R satisfy the conditions 
of Theorem 1. Then the necessary and sufficient condition that there 
exist a function P(x, i/, 2 ), such that 


is that 





dy dx^ dz dy* dx dz* 


for every point of the region. The function F(Xy z) is given by the 
formula 

Fix, y, z) = dx + Qdy + R dz). 

Corollary. The necessary and sufficient condition that 


P dx + Qdy + Rdz 


be an exact differential of some function y, z) is that 


dy dx* dz dy* dx dz* 

for every point of the region. The function z) is determined 

from the formula 

^{x, y, z) = dx + Qdy + Rdz) + const. 

^ (a,o,c) 

60. Applications of Line Integrals. 

1. Change of Variables in a Dovbh Integral. A formula for the 
change of variables in a double integral was developed in Sec. 
46, and it is advisable to review Secs. 46 and 47 before reading 
this section. A more elegant, though less direct, derivation of 
the relation established there is given below with the aid of the 
concept of the line integral. 

Considei^ again the equations of transformation of Sec. 46, 
(60-1) X = <(>i(«, v), y = <piiu, v), 
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where v) and v) together with their first partial 

derivatives are continuous in the region under consideration. 
The equations (60-1) may be regarded as the equations of trans¬ 
formation from one set of rectangular cartesian axes u, v to 
another set of rectangular axes x, y. The area A of the region R 
enclosed by the curve C is given by the formula (64-4), 


A = f^xdy. 


Substituting for x and dy from (60-1) gives 


(60-2) 


A = v) d<f> 2 (u, v), 


where C' is the boundary of the region R' in the wv-plane, which 
corresponds to the region R in the a;y-plane. 

But 

dvtiu, ^ ^ 

so that the integral (60-2) becomes 

A = J^[^i(w, du -b v»i(«, dt;]. 


Setting 




mu,v) = vi^, 

and applying Green’s theorem (Sec. 55) gives 

= ff 

J Js' dv du du dv\ 

~ J* ^ 
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J(w, v) = 


Sipi 

S<p2 

du 

du 

dipi 

d<p2 

dv 

dv 


It follows from the mean-value theorem for double integrals 
(see problem in Sec. 42) that 


dA = |J(^, rj)\ du dv. 

The absolute value bars were introduced in the foregoing because 
the area is essentially positive. 

2. Work, It will be assumed that a force y) acts at every 
point of the xy-plane (Fig. 63). 

This force varies from point to 
point in magnitude and direc¬ 
tion. An example of such con¬ 
ditions is the case of an electric 
field of force. The problem is to 
determine the work done on a 
particle moving from the point 
A (a, b) to the point B(c, d) along 
some curve C. Divide the arc 
AB of C into n segments by the 
points Pi, P 2 , . . . , Pn-i, and 
let As* = P*Pt+i. Then the force acting at P* is P(x,, y*). 
Let it be directed along the line P*S, and let P*P be the tangent 
to C at P*, making an angle Si with PiS. 

The component of force P(x*, t/,) along P*r is F cos and the 
element of work done on the particle in moving through the 
distance As* is approximately P(x*, y*) cos Si As,-. The smaller 
As*-, the better this approximation will be. Therefore, the work 
done in moving the particle from A to B along C is 



n — 1 


W = lim ^F{xi, yi) cos Si As< = v) ^ 


»-o 


If a is the inclination of PS and P is the inclination of P.-P, 
then 


^ = a — and cos ^ = cos a cos -h sin a sin 
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so that 


(60-3) W = 2 /) (cos a cos + sin a sin ff) da. 

From the definition of a it is evident that 

F cos a = x-component of F = X, 

F sin a == ^/-component oi F ^ Y. 


Moreover, since ^ = cos 


= sin jS, 


cos ds — dx and sin ds = dy. 

Therefore (60-3) becomes 

W = f^iXdx + Ydy), 

which is a line integral of the form (53-3). 

If C is a space curve, then an argument in every respect 
similar to the foregoing shows that the work done in producing a 
displacement along a curve C in a field of force where the com¬ 
ponents along the coordinate axes are X, F, and Z is 

W = J^(X dx + Ydy + Z dz). 

To illustrate the use of this formula, the work done in displac¬ 
ing a particle of mass m along some curve C, joining the points 
A and B, will be calculated. It will be assumed that the particle 
is moving under the Newtonian law of attraction 



where k is the gravitational constant and r is the distance from 
the center of attraction 0 (containing a unit mass) to a position 
of the particle (Fig. 64). 

The component of force in the direction of the positive x-axis 
is 


X = F cos (x, r) 


km X 
r* r 


km y 
r* r 


and Z 


km z 
r* r 


Similarly, 
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W = — dx-\-ydy dz). 
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But 


r = V »- + ir’+»’ and * = 

T 

Therefore, 

^ =“‘“X*? - K?l*’ 

which depends only on the coordinates of the points A and B 



and not on the path C, Denoting the distance's from 0 to A 
and B by ri and r 2 , respectively, gives 


W 


= km(l - 1). 

\r2 ri/ 


kff% • 

The quantity ^ — is known as the gravitational potential 


of the mass m. It is easily checked that 


A = —; 
dx 


Y = 


dy 


Z = 


d4> 

dz' 


so that the partial derivatives of the potential function ^ give 
the components of force along the coordinate axes. Moreover, 
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the directional derivative of in any direction s is 

dx . dy . dz 
ds ^ ^ ds dy ds dz ds 

= X cos (x, s) + F cos (y, s) + Z cos («, s) 

where F, is the component of force in the direction s, 

A conservative field of force is defined as a field of force in 
which the work done in producing a displacement between two 



fixed points is independent of the path. It is clear that in a 
conservative field the integral 

f^(Xdx + Ydy + Zdz) 

along every closed path is zero, so that the integrand is an exact 
differential. 

3. Flow of a Liquid. Let C be a curve on a plane surface across 
which a liquid is flowing. The xy-plane will be chosen to coincide 
with the surface. The lines of flow are indicated in Fig. 65 by the 
curved arrows. It will be assumed that the flow of the liquid 
takes place in planes parallel to the xjz-plane, and that the depth 
of the liquid is unity. The problem is to determine the amoimt 
of liquid that flows across C in a unit of time. 
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If Vi is the velocity of the liquid and cu is the inclination of the 
tangent to the line of flow at Pi, then = r,* cos «»• is the x-com- 
ponent of Vi and ry|»- = Vi sin cti is the ^/-component of v,-. Let 
Asi denote the segment PiP< fi of C. A particle at Pi will move 
in time M to PJ while a particle at Pi^i will move to PJ 4 . 1 . 
Therefore, the amount of liquid crossing PiPi+i in time M 
is equal to the volume of the cylinder whose altitude is unity 
and whose base is PiP^+iPJ+iPJ. Aside from infinitesimals of 
higher order this volume is = PiPJ • P^Pi+i sin di, in which Bi 
denotes the angle between PiPJ and PiPi^i. But PiPi+i = As* 
and, except for infinitesimals of higher order, PiPJ = r* At. 
Therefore AVi = Vi At - As< sin Si. The volume of liquid crossing 
C in a unit of time is 

n 

V = lim Vvi sin 6i As*. 

n-+ 

♦ "I 

If Ti denotes the inclination of the tangent to C at P<, then 
n == Bi -j- ai. Therefore, 

Vi sin Bi Asi = v<(sin n cos ai — cos n sin a<) A$i 

= Vi cos ai sin r< ASi — Vi sin a< cos r» ASi 

= Vz\i Al/i - Vy\i AXi. 

Hence, 

(60-4) V = J^(-Vydx + Vz dy) 

is the line integral which gives the amount of liquid that crosses 
C in a unit of time. 

If the contour C is a closed one and the liquid is incompressible, 
then the net amount of liquid crossing C is zero, since as much 
liquid enters the region as leaves it. This assumes, of course, 
that the interior of C contains no sources or sinks. Thus, a 
steady flow of incompressible liquid is characterized by the 
equation 

dx + Vz dy) = 0 , 

over any closed contour not containing sources or sinks. This 
implies that (see Sec. 56) 

dVy SVz 

lx’ 


(60-5) 
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which is an important equation of hydrodynamics known as the 
eqvMion of continuity. Moreover, from Theorem 3, Sec. 56, it is 
known that there exists a function ^ such that 

(60-6) = -t;, and ^ = t;.. 

This function ^ is called the stream function, and it has a simple 
physical meaning, since 

’*'(*» v) = 

represents the amount of liquid crossing, per unit time, any curve 
joining (a, 6) with {x, y). 

The function defined by the integral 

(60-7) #(x, y) = + v„dy), 

is called the velocity potential. It is readily shown that 

(60-8) ~ = v, and ^ = t»„. 

Comparing (60-6) with (60-8), it is seen that 

These are the celebrated Cauchy-Riemann differential equations. 

If the integral (60-4) around a closed curve C does not vanish, 
then the region bounded by C may contain sources (if V is 
positive) or sinks (if V is negative). The presence of sources 
or sinks is characterized by the singularities of the function 
that is, those points for which ^ is not continuous or where its 
derivatives may cease to be continuous. * 

The foregoing discussion is readily generalized to a steady 
flow of liquids in space. Instead of the integral (60-7) one will 
have 

*(*, y, *) = dx + Vydy + v. dz), 

* See in this connection Sec. 57. 
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and if this integral is independent of the path C, the equations 
corresponding to (60-5) are 


^ dVg _ dVy _ ^ dVx _ dVg _ ^ 

^ dx * ly ~ aS “ 

In such a case the integrand is an exact differential, and the 
velocity potential ^(x, y, z) gives 




dz 


Vg. 


4. Therrmdynamics, If p, and U are the pressure, volume, 
and internal energy of a gas enclosed in a receptacle, then they 
are connected by the equation 

(60-9) /(p, V, U) = 0. 

Hence, the state of a gas is completely determined from (60-9) 
by specifying any two of the three quantities, say p and v, 
which can be regarded as representing the coordinates of a 
point P in the pti-plane. If the state of the gas changes, the 
point P describes a curve C, and if the process is cyclic, the curve 
C will be a closed one. 

It is important to know the amount Q of heat lost or absorbed 
by the gas while the gas in the receptacle (for example, steam 
in an engine cylinder) changes its state. Let Ap, At;, and AU 
be the increments of pressure, volume, and energy when the 
amount AQ of heat is added. Then 


AQ = AU + pAv, 

If p and V are considered the independent variables, then U is 
determined from (60-9), giving U = t/(p, v). Hence, approxi¬ 
mately. 


ATT dU , dU 
AU = — Ap + — Av. 
dp ^ dv 


Therefore, except for infinitesimals of higher order, 
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As the state of the gas changes, p and v vary along a curve C 
in the pv-plane, and it is clear that the total amount of heat 
introduced into the gas during this change is 

(60-10) « _ ip + -I- p) *,]. 

The integral (60-10) is obviously of the form 

v) dp -H N{p, v) d»]. 

If, during the expansion of the gas, there is no gain or loss of 
heat, then the process is called adiabatic. It is characterized 
by the equation dQ = 0. 

PROBLEM 

Show with the aid of (60-5) that the velocity potential ^ satisfies 
the equation of Laplace, 

dx^ dy^ 



CHAPTER VII 
INFINITE SERIES 

61. ^[n^te Series. Let ui, ut, u», •••, Un, ••• he any 
sequence of quantities; then the S 3 Tnbol 
00 

(61-1) Wn = + W3 + • * • + Un + * * 

is called an infinite series. With the aid of the symbol (61-1) 
one can form a new sequence {si\ whosa elements are sums of a 
finite number of the terms of the series (61-1): 

51 = Ui, 

52 = Ui + Ui, 

53 = Ui "K U 2 + Us, 


Sn = Ui + U2 + Us + * • ’ + Un, 


The numbers Si will be called the ith partial sums of the series 
(61-1). 

00 

Definition. An infinite series ^Un is said to converge if the 

n“ 1 

sequence of partial sums {si\ is convergent, A series which does 
not converge is called divergent. 

Stated in symbolic form this definition of the convergence 
of an infinite series is* 

(61-2) lim Sn = S, or \S — Snl < c, for all n ^ p. 

n -* *0 

The number S is frequently called the sum of the series (61-1), 
although one should clearly realize that it represents the limit 
of the partial sums «». 


* See Sec. 3. 


200 
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A necessary and sufficient condition for convergence of any 
sequence was given in Sec. 5, and it will be restated here for 
easy reference. 

A necessary and sufficient condition for the convergence of 

m 

2^ Un is that for any € > 0, one can find a positive integer p {depend- 

n — l 

ing on c) such that 

ISn — ««1 < € 

whenever n and m both exceed p. 

It is clear that the series cannot converge if its partial sums 
Sn are unbounded, that is, if \sn\ can be made greater than any 
preassigned positive number JIf. However, the boundedness 
of partial sums does not ensure the convergence, as can be seen 
from the simple example of the series 

Here Si = 1, «2 = 0, Sj = 1, • • • , S2n~i = 1, S2n = 0, • • • , 
and the Sn are clearly bounded, but the sequence 

1 , 0 , 1 , 0 , 1 , . . . 

does not converge. 

Infinite series possess some properties which follow directly 
from the definition of convergence and from the fundamental 
criterion of convergence of sequences: 

•0 

(A) The convergence or divergence of a series Un is not destroyed 

n —1 

by adding to or subtracting from it a finite number of terms. 

This follows directly from the fundamental criterion. Let 
the series be convergent; then for any € > 0 one can find a posi¬ 
tive integer p such that for any pair of numbers m > p and 
n > p. 

This condition, certainly, remains unaltered by the addition (or 
subtraction) of a finite number of terms. To be sure, the sum of 
the series will be altered by the addition (or subtraction) 
of a finite number of terms, but the property of convergence will 
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not be aflfected. Thus, if the sum of the series Un is S, then 

n — 1 

the addition of a finite number of terms ai + 02 4* • • * + a* 
will give for the sum of the new series /S + ai + 02 + • • • + Ok- 
A similar argument can be supplied if the series diverges. 


(B) The limit of the general term Un of the series ^ Un is neces- 


n-l 


sarily zero if the series is convergent. 

For 

Un ~ Sfi Sn—1, 

and if the series converges, then 

lim Sn = S and lim Sn~i = S. 


Thus, 


lim Un = lim Sn — lim Sn~i = 5 — jS = 0. 

n—♦ n—► n—♦ «o 


The condition enunciated is necessary but not-aufficient, 
that is, a series may diverge even though lim Wn = 0. A classical 

n—♦ » 

example illustrating this case is the harmonic series 




+ S + 


in which 8„ increases without limit as n increases, as will be 
shown next. 

Since 

1 , 1 I ■ ■ ■ I 1 . 1=1 

n + 1 n + 2^ n + n ^ 2n 2’ 

it is possible, beginning with any term of the series, to add a 
definite number of terms and obtain a sum greater than 
K n = 2, 

yz + yi>V2-, 

n = 4, 

y + % + 

n “ 8, *■ 

H + Ho + * • • + He > H; 



212 


ADVANCED CALCULUS 


§61 


n = 16, 

Kt + Ks + • • • + M2 > M- 

Thus it is possible to group the terms of the harmonic series* 

i+M + (M + M) + (M + M + M + M)+--- 

in such a way that the sum of the terms in each parenthesis 
exceeds and, since the series 

l+M + M + MH" • ' • 

is obviously divergent, the harmonic series is divergent also. 

«e 

(C) Let the sum of the series Un be S. If a new series is formed 

n —1 

by multiplying each term by a constant k to form the series 

kui -|“ ku2 “b * * * “b kun “b * * * , 

then the sum of the latter series is kS. 

For, let 

5n = + W 2 + • • * + Wn 

and 

»n = + • ' ’ + kUn; 

then 

5^ == A/Sn. 

Hence, 

lim Sn = k lim Sn = kS. 

n—► « n—► » 

(D) Given the two convergent series 

^1 + ^ 2 + • * ‘ ‘ • 

and 

+ ^2 + ' * * + Vn + • • • . 

* The fact that the associative law holds unrestrictedly for series of 
positive terms follows from the fact that the partial sums of the series 

(1) (Wi + -h • • • + tir) + (Wr+1 + * * * + W*) + • • • 

are subsequences of the partial sums of the series 

(2) til -|- + Wa + • • • "b tin + • • • * 

Hence, (1) and (2) will diverge or converge together. 
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Let the sum of the first series be U and that of the second be V", then 
the series 


(61-3) («i ± »i) + (ui ± t>s) 4 • • • -I- (w» ± o«) 4- • • • 

has the sum U ± V. 

Let 

4” M* 4“ ■ ■ ■ + Un, 

^ 4" 1^2 4" * ' ■ 4* VnJ 

then 


Sn ± si = (ttl ± »i) -1- («2 ± tlj) 4- • • • -f {Un ± Vn), 

but this is precisely the nth partial sum of the series ( 61 - 3 ), 
which can be designated by s". 

Then 

lim (s„ ± si) = lim s" 

n—► • n—♦ ao 

or 

[/ ± ? = lim s'f. 

n —* 00 

This result can be stated as follows: 

C mveraent series may be added or subtracted term by term. It 
should be noted that this property has been established for a 
particular mode of addition. It will be seen below that the sum 
of the series may depend on the order in which the terms are 
added. 

62. ^ries of Positive Terms. This section will be concerned 
exclifcSively with series whose terms are nonnegative numbers. 
The property (A) of the preceding section states that one can 
discard any finite number of terms without affecting the con¬ 
vergence of the series, so that the conclusions of this section, 
in regard to convergence, will also be applicable to any series 
containing a finit^number of negative, terms. 

Theorem 1. A series of positive terms is necessarily convergent if 
its partied sums are bounded. 

Since the terms of the series are positive, the partial sums 
will form a monotone-increasing sequence of numbers, that is,* 

^ 52 ^ Sz ^ * * * ^ Sn ^ * * , 


* The equality sign allows some terms to be sero. 
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and a bounded monotone sequence is necessarily convergent 
(see Sec. 6). 

« 

Theorem 2. If ^Un is a convergent series of positive terms^ 

n —1 

and {On} is any hounded sequence of positive numbers, then the 

eo 

series anUn is convergent. 

n — 1 

Since the numbers Un are bounded, 

On < M. 


Then the nth partial sum of UnUn is less than Msny where Sn 

n“l 

00 

is the nth partial sum of 2) From Theorem 1 it follows that 

n —1 

<0 

anUn is convergent, since its partial sums are bounded. 

n —1 

Example 1. Consider 


^a^ ^ a + a^ + a^ + • * • + + * * “ • 

n-l 

(а) If a ^ 1, ^ n so that the partial sums are not bounded, 

and hence, the series diverges. 

(б) If a < 1, the series is a convergent geometric series. For 
the sum of n terms of a geometric progression of ratio a is^ 


Thus, 


a(l — g”) _ _a_ 

1—a ’”1 — a 1—0 



* The sum of n terms of a geometrical progression of ratio r and whose 


first term is a is 


0(1 - f») 

1-r 
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SO that the partial sums are bounded. (Consequently the series 
converges. In fact, lim «» = —, since lim o"+‘ = 0, if 

n—* • 1 “ O • 

a <J^ 

Example 2. (Consider 


-1-1—i—I—i—I- 

l-2^2-3^3-4^ 
This series can be written as 


n(n + 1) 


~ 0 + G “ 0 + " + G “ ;r^) 


Hence, the nth partial sum is 


Sn = 1 - 


n + 1 


Thus, Sn is bounded, so that the series is convergent. 

ae flo 

Theorem 3 (Comparison Test). Let m„ and ^ be two series 


n—1 n*l 


of positive terms, the first of which is known to be convergent and 
the second divergent. 

•e 

(а) If the terms of a given series ^ an of positive terms are such 

n«“ 1 

ae 

that On ^ Wn, for every n ^ m, then the series ^ an is convergent. 

n — 1 
ae 

(б) If the terms of a given series ^ an of positive terms are such 

n — l 

ae 

that an ^ Vn, for every n m, then the series ^ an is divergent. 

n —1 

In order to establish part (a) of the theorem, assume* that 
the inequ^Ji^ Un ^ Un is satisfied for every term of the series, 
so Denote the nth partial sum of the given series 

ae ' . « ae 

by an, and that of the series ^Un by C7n. Then 

n—l n—1 

‘ Un. 


This entails no loss of generality. See property (il). Sec. 01. 
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Since the sequences {8»} and {I/n} are monotone increasing and 


the series ^ m„ is convergent, it follows that 

n — 1 

8„ :£ lim f7* = V. 

n—* 

Thus, the sequence {snl is bounded, and, therefore, the series 
2^an is convergent. 

n —1 

In order to prove the second part of the theorem, denote the 
00 

nth partial sum of by F„; then 

»-i 

8« S: F„. 


But, by hypothesis is divergent, so that {Fn} is an unbounded 

n — 1 

00 

sequence, and hence diverges. 

n —1 

This test was used essentially in establishing the divergence 
of the harmonic series in Sec 61. 


Theorem 4 (Cauchy’s Root Test). If a given series ^an of 

n —1 

positive terms is such that 

(a) ^ r < 1, for every n ^ m, where r is independent of 


n, then the series ^ an is convergent 

n»l 

//, however f 

00 

(5) ^ ^)for every n m, then the series ^ an is divergent. 

n-l 

There is no loss of generality in assuming that the inequalities 
(o) and (6) are satisfied for m = 1. It follows from (o) that 

o„ :S r», 

so that no term of the given series exceeds the corresponding term 
of the geometric series 

f + + r"+***, 
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which is convergent, since 1. Thus, by Theorem 3, the 
given series converges. 

The truth of the assertion of the second part of the theorem 
follows from property (B) of Sec. 61. If \/^ ^ 1, the general 
term of the given series does not tend to zero, and hence, the 
series must diverge. 

00 

Corollary. If the given series ^ an is such that 

n — l 


lim = r < 1, 

n—> • 

then the series is corwergent. 

If 


lim > 1, 

n—> «o 


then the series ^ an diverges. 

n-1 

Consider first the case when r < 1, and choose a positive 
number c so small that 


r 4- € < 1. 

Then, for any sufficiently large n, the quantity can be 

made to differ from r by less than €, that is, 

,j r — € < < r + c. 


But r + € = r' < 1, and it follows from Theorem 4 that the 
series converges. 

The proof of the case when r > 1 follows directly from property 
(5) of Sec. 61A 

Theoreii\Jy(d’Alembert’s Ratio Test*). If the terms of a series 

00 

an of positive terms satisfy, from some valu e of n onward, the 

n ■■ 1 ■ 

inequality 


r < 
an 


1 , 


* Also known as Cauchy*s ratio test. 
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where r is independent of n, then the given aeries is convergent. 
Iff however f from and after some valve of n 




^ 1 , 


then the given series diverges. 
Let 


Qn4-1 

an 


^ r, (r < 1). 


Then, 

(62-1) ttn+i ^ ran, 

and the inequality may be assumed to be satisfied for all n ^ 1. 
Hence, "'•—“ 

On+i ^ ran, 
an ^ ran-.i, 

On—1 ^ ran—2> 


as S ratf 
02 ^ rai. 


Forming the product of the left-hand members and the product 
of the right-hand members of these inequalities and dividing 
out common factors give 

^ r»ai, (n = 1, 2, • • • )• 

Thus, the terms of the given series are less than or equal to the 
corresponding terms of the geometric series 

ai(r + r* + • • • + r" + • • • ), 

which is convergent since r < 1. Hence, the given series is 
convergent by the comparison test. 

The proof of the second part of the theorem is left as an exer¬ 
cise for the reader. 


Corollary^ If the given series ^ an is such that 

n-»l 

lim = r < 1, 

n—► • an 

then the given teriee eonvergee. 




{«S 

If 
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Um 1, 

n—♦ «o 


then the series 2^ an diverges. 

n-l 

The proof is identical with that of the corollary to Theorem 4, 
where replaces 

In applying Theorems 4 and 5, to establish the convergence 


Qn-t-l 


of the series ^^an, it is essential to note that and — 


n — 1 


must be less than some fixed number r smaller than unity for 
all values from some n onward. For example, in the harmonic 
series 


«0 

n — 1 



each of the expressions 

Qn+i _ ri 

a» ~ n + 1 



00 ^ 

is always less than 1, but the series V - diverges. The difficulty 

n 


n — 1 


here lies in the fact that no fixed number r, independent of n, can 
be assigned for which 


n 


n + 1 


r < 1. 


This ratio can bo made to approach arbitrarily near unity, which 
is in violation of the requirement that 


^ ^ r < 1. 
an 

In other words, ^ a» and must ultimately be less than some 

dn 

fixed number r, which is smaller than unity. 
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In general, the ratio test is easier to apply than the root test, 
but the latter is more powerful. It will be seen from the example 
given below that the root test is capable of furnishing positive 
information when the ratio test fails. It may be remarked 
that the root test is always applicable when the ratio test is 
applicable.* 

The corollaries to Theorems 4 and 5 are of most frequent 
use in practical applications, but if the limits involved fail to 
exist, one may have to apply the theorems themselves. Thus, 
consider the series 

r|sin a\ + r^jsin 2a| + • • * + r"|sin na| + • • • , 

where a is an arbitrary constant. 

In this case 

fln-f-i _ I sin (n + 1 )q? 

On r* sin na 
sin (n + l)a 
sin na 

This ratio does not approach any limit. In factf 

sin (n + l)a 
sin na 

may assume values greater than unity as w —> oo. But the root 
test gives 

= -^r^lsin na\ = rv^jsin na\ ^ r. 

Thus, if r < 1, the series converges, no matter what a is. It 
should be noted here that lim On does not exist. 

As an example of the application of the corollaries to Theorems 
4 and 5, consider the series 

a; + + 3a:* + • • • + wa?*' + ' • * , 

* For details, see K. Knopp, Theory and Application of Infinite Series, 
Sec. 36, English edition. 

t However, it is impossible to find an integer m such that for all n ^ m, 
is greater than unity. 


sin (n -f 1)« 
sin not 
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where x ^ 0. The test ratio is 


221 


and 


On+l _ n + 1 
o« ~ n x“ 





Urn = X. 

n—» • ttn 


Thus the series converges if 0 rS x < 1 and diverges if x > 1. 
When X = 1, the test fails, but the series 

1+2 + 3 +•••+»+••• 


is obviously divergent. 

The root test furnishes the same information, since 

X. 


But* 


lim — h V- 

n—♦ « 


SO that 


lim X =5 a:, 

n—»00 


and if 0 ^ X <1, then the series is convergent. 
The series 


10 ^ 10 * ^ 10 * ^ 


+ — + 
^ 10 ” ^ 


is readily shown to be divergent by the application of the ratio 
test. For 


lim^‘ 

n-^ • 



(n + 1)!10” 
n!10”+* 


= lim 

n-» • 


n + 1 
10 


00 , 


The ratio test, in the form given in the corollary to Theorem 
6, is very easy to apply, and if it fails in a given case, one may 
attempt to find a suitable comparison series and apply Theorem 3. 


* log V^n = - log n, which tends to zero when n -♦ «. Hence 
^ n 


e® » 1. 
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As an illustration of this circumstance, consider 


1 + p + ^ + 

In this case the test ratio is 


+ • • • 


so that 


(n + 1)*' 


lim = 1. 


so that lim = 1. 

Hence, neither of the tests given in the corollaries furnishes 
information regarding convergence. In this case, one may 
^jcisQTt to the CQmparison test. 

^ / Now consicier the more general series, 


(62-2) i + |. + ^+...+i+.... 

It will be shown that this series converges for every p > I and 
diygrges whenever 0 

'' The terms of the series (62-2) may be grouped as follows: 
(62-3) 1 + (|: + ^) + (^ ++ ^ + ^) + • • • 


(( 2 *-‘) 




where the fcth group contains 2*"“^ terms. The sum of the terms 
in each parenthesis is less than the number of terms in that 
parenthesis multiplied by the first term. Hence, the terms of 
the series 


(62-4) l+2-l-f-4-lH- 




are not less than the corresponding terms of the series (62-3). 
But the series (62-4) is a geometric series of ratio Hence, 
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if p > 1, the ratio is less than unity, so that (62-4), and therefore 
(62-2), will converge. 

It remains to establish the divergence of the series for p ^ 1. 
Note that p = 1 gives 

1 “f" — *4“ — • • • -l- — -4“ • • • 


which is known to be divergent. But the nth term of this series 
is not greater than the corresponding term of the series (62-2) if 
p < 1, since 


Hence, by the comparison test, the series (62-2) diverges for 

p < 1. 

The series (62-2) and the geometric series are frequently 
used as the standard comparison series. . 

A similar argument can be used to establish the divergence 
of the series 


+ 31 ^ + • • • + + • • • . 

Let the terms of the series be grouped as is indicated below: 


2 log 2 \3 log 3 ^ 4 log 4/ \5 log 5 

(-1 

\9 log 9 


8 log 


1_) 

og 8/ 


+ 


+ 


+ 


1 


16 log 16. 


:) 


+ 


Evidently, 


1 , 1 ^ 2 .. 1 1 
3 log 3 4 log 4 ^ 4 log 4 2 2 log 2' 

1 , 14^11 

5 log 5 8 log 8 8 log 8 3 2 log 2’ 

1 , I 1 ^ 8 _ 1 1 

9 log 9 "^16 log 16 16 log 16 4 2 log 2’ 


Therefore, the terms of the series 

2l^(^ + l + 5+ '+^+'“) 
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are not greater than the corresponding terms of the given series, 
and the series (62-6) is obviously divergent. It follows that the 
senes (62-6) is divergent. 

i4s a further illustration, let it be required to test the series 




J_ +J_ + 

1 • 2 ^ 3 • 4 ^ 


+ 


Here, 


lim = lim —ttwo— 

n-..* an n-«o(2n + l)(2n + 2) 


,. 4n2 — 2n 

= lim , V - v; — t-t; = hm 


(2n — l)2n 

(2n - l'^2n 




-|-6w + 2 _ 

^ 2n'^ 2n2 


= 1 . 


Hence, the test fails, but if the given series be compared with the 
series (62-2), for p = 2, it is seen to be convergent. 


PROBLEMS 


1. Prove that ^ i i + • • • + i + 

2. Prove that 1 + ^ • • ’ + 

o o 


1 


2n - 1 


• • diverges. 

+ • • • diverges. 


3. Test the series 1 + ^ ' ' ’ + 2 ^ -!-••• 

4. Test the series 1 + + r"^ + • * * + r— 

log 2 log 3 log n 

5. Test for convergence: 

1 . 1 . 1 . 1 , . . . . 

2 2 • 2* 3 • 2® 4 • 2* ' 

/I.N 1 ^ 1 • 2 , 1 • 2 • 3 ^ 

W 3 + F5 + FW + ■ ' ■ ’ 

(c) 1 + + p + • • • ; 

2 2* ^ 2* 2* * * * * 


6. Show that 1 + 


V2-3 


n(n + 1) 


diverges. 
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7. Show that the series 1 + i + 5 ^ + 

5 10 

convergent. 

«0 

8 . Show that ^ converges. 


9. Show that 




n — 1 


V^n(l + n*) 


converges. 


10 . Show that ~ diverges. 


n — 1 


11 . Show that — - 7 =^ -diverges. 

V n log n 


n-2 


12 . Show that — converges, if a; ^ 0 . 


n-l 


+ T-ir~i + * • * is 
1 + n* 


13. Show that converges, if a? ^ 0 . 

n “ 1 
00 

14. Show that converges, if 0 ^ x < 1 . 

n-l 

00 

16. Show that diverges, if x > 0 . 


n — 1 


63.\ h^re General Tests. The tests established in Sec. 62 are 
those most commonly used in practice. There are many more 
general criteria of convergence than those given in the preceding 
section, but thrfr application is considerably more involved.* 
Some of the smrper criteria are discussed in this section. 

Theorem^^^piuchy’s Integral Test) • Let ^ an be a given series 
of decreasing positive terms. If there exists a vositive —. 


* See, for example, Knopf, K., Theory and Application of Infinite Series. 
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^^^creasing function f(x) for x ^ 1, such that f[n) = an, then the 
gtveh series cumerffes tf the integral 

f'‘f{x)dx 

exists; the given series diverges if the integral does not exist. 

By hypothesis /(n) = a^ therefore, the nth partial sum of the 
given series is 

n n 

Let the values of f(i) be plotted as the ordinates (Fig. 66); 
then each term of the series can be interpreted as the area of a 



rectangle of base unity and height/(i). Each of these rectangles 
extends above the curve y = /(x), so that the area of the sum of 
the n rectangles is greater than the area under the locus of — /(x) 
bounded by the x-axis, and the lines x = 1 and x = n + 1. 

(63-1) Sn > r 

On the other hand, the sum of the areas of the inscribed rectangles, 

n + l 

O* + + * * ' + = ^fWi 

n-2 
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is less than the value of the integral dXj so that one 

can write 

n+l 

dx. 

n'«2 

But 

n + l 

^/(n) = s«+i - Oi. 

n »2 

Hence, the inequality just above can be written as 
(63-2) dx -|- oi. 

But the function y = f(x) is positive; hence 

dx < f^yCx) dx. 

If the integral on the right converges to a value L, then it follows 
from the inequality (63-2) that 

Sn+l < L + Ui. 

Thus, the partial sums are bounded, and by Theorem 1, Sec. 62, 
«0 

the series ^ Un converges if the integral does. If, on the other 

n*»l 

hand, the integral becomes infinite, it follows from the inequality 
(63-1) that the series diverges. 

It may be remarked that it is not necessary to demand that 
/(n) be equal to Un for all values of n beginning with n = 1. 

If m is any number, greater than unity, and if the condition 

00 

f(n) = On is satisfied for n ^ m, then the series ^ an and the 

n*l 

integral f */(x) dx will converge and diverge together. 

Examfte 1. Test the harmonic series 

^11 1 
14 -± 4 .± 4 - 
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Here/(a:) = -» since /(n) = -• Now the integral 

X Tl 

I -dx = log n 
Jix 

and 

C^dx rdx , 

I — = hm I — = lim log n = oo 

Jl X n->« Jl X n-^oo 

SO the given series is divergent. 

Example 2. Test 


- + - + — + 
2 ^ 5 ^ 10 ^ 




m = 


= tan~^ n — tan“^ 1, 

r2 ' 


lim (tan“^ n — tan“^ 1) = -j) 

and, since the integral converges, the given series is convergent. 

The test of d^Alembert (Sec. 62) is merely a particular case 
of an extremely general test due to E. Kummer, from which a 
galaxy of important special tests can be deduced. 
Theorem^^.v(Kummer’s Test). The series of positive terms 

Un is covlvergent if there exists a seqmnce of positive numbers, 

n»l 

{ttn}, such that from some value of n onward, 


(63-3) 
However, if 
(63-4) 


On—- an+i > r > 0. 

Un+1 


an+1 ^ 0, 


then the given scries diverges, provided that the series diverges, 

^md dn 

n-*l 

It may be assumed, without loss of generality, that (63-3) 
is satisfied for n ^ 1. 
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Setting « = 1, 2, 3, 4, • • • , n — 1 in (63-3) gives, 

OiWi — CiUi ^ riij, 
aiUi — aiUa ^ ru», 


o«_iM„_i — a„w„ ^ rM„. 

Adding these inequalities term by term gives 
(63-6) OiUi — a„M„ ^ r(s„ — Ui), 

where s„ is the sum of the first n terms of the given series. It 
follows from (63-6) that 


rs„ ^ aiMi — o„M„ rwi, 


or 


. ^ (fll + r)Ml flnUn 

S - — 

^ (a, -f- r)ut 

-- , 

r 


Thus the sum of any number of terms of the given series is 

bounded ^since is independent of n^, and, hence, the 

series converges by Theorem 1, Sec. 62. 

In order to establish the second part of the theorem, note 
that (63-4) gives 

GiUl ^ a2U2 < • • • < ttnUn. 

Hence, 

^ 1 

Un ^ aiUi - f 

Un 

and 

« 00 

2“- ^ '““■Ss- 

n-l n—1 

00 

By hypothesis, the series diverges; consequently, the 

n-1 


series ^ Un also diverges. 

n-l 
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It will be observed that for = 1, (n = 1, 2, 3, 
test of Kummer specializes to that of d’Alembert. * 

Wn+l 


§68 

), the 


If the series ^Un is such that lim = 1, the ratio 

n—♦ • Ufi 


test 


n* 1 


fails. A test due to Gauss frequently enables one to determine 
the behavior of the series in this doubtful case. 

_ oo 

Theorem 3 (Ga^s* Test). If the series w* of positive terms 

is such that the ratio —^ can be written in the form 

Un+l 

Un ^ 1 * , Mn) 

^in +1 n ' 

where A{n) is a hounded function of n as n—> co, then the series 
converges if h > and diverges if h ^ 1. 

The proof of this test follows from the test of Kummer. 
Consider first the case when A 5 *^ 1, and set an in Kummer’s 
test equal to n. Then 

.'h (“•;£; - ["(' + s + 

= A - 1. 

If A > 1, then A — 1 = r > 0, and it follows from Kummer’s 

test that the given series is convergent. On the other hand, if 

00 

A — 1 < 0, the test of Kummer ensures divergence, since 

n — l 

is a divergent series. It remains to consider the case when A = 1. 
00 

Note that the series ^ is divergent, t and set On in 

n —1 

Kummer’s test equal to n log n. Then, 

On^ -cu+i = n log n(l +1 + - (n + 1) log (n + 1) 

Wn+1 \ n n* / 


* See also Raabe’s test in Prob. 6, p. 233. 

t This fact can be readily established with the aid of the integral test of 
Cauchy; see also (62-6). 
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n log n + log n + 4(”) ” 

n 

- (n + 1) log (n + 1) 
= („ + l)log^+4Mi28i?, 

which tends to — 1 as n —> oo since ^ 0, and 

’ n ’ 

(» + 1) log . -log [(l + 0 (l + 0] 

tends to —1 as n increases indefinitely.* ) 

Example 1. Consider the series 


i+L:3 + Li3i5 + 


Un ^ 2n + 2 ^ j , J__ 1 

‘Un+i 2 h ~|- 1 2w 271(2/1 -|- 1) 

Since ^ = h and A(n) =-the series is divergent. 

^ 4 + - 

n 


Example 2. Consider the series 


2 1 • 3 • • • (2/1 - 1) 1 

2 • 4 • • 2n ‘ 2n + 1* 


Un _ (2/1 + 2)(2/1 4“ 3) ___ 4/1* 4" lO/i 4“ 6 
Un+i (2n 4 - 1)* ~ 4/1* 4 - 4n 4 “ 1' 

Dividing the numerator by the denominator gives 


_«^<=l+A_ 2 n 

1 ' 2n 4n* + 4» + 1 


* See See. 10. 
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and since A = % and 


A(n) = 


^ +4 


is bounded when n —> oo, the series is convergent. 

PROBLEMS 

1. Test for convergence: 

(«) 2"^’ 

, Vn 

ni« 1 

<« 

n — 1 
«a 

2 (n - 1) + n*’ 

n — 1 

n-1 

«D 

^ ^ /l • 3 • • (2n - liy 

2. Discuss the convergence of I- 2 4 • ' * ■ 2n —/ 


n —1 


§6S 


where p > 2 and p 2. 

iln«. Convergent if p > 2; divergent if p 2. 

3. Discuss the convergence of 


2:4 2 ^ 

1-31-3-5 

4 . Discuss the convergence of 


. Ans, Divergent. 


2 24... 
1 • 3 • • (2i 


2n 


n-l 


{2n — 1) 2n + 2 


Ans, Divergent. 


5 . Discuss the convergence of 


• 3 • • • (2n - 1) 4n + 3Y 
2-4 - • • 2n ’2n + 2/ 

fl""l 
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6. Deduce, with the aid of Eummer’s test, the following test due to 
Raabe: 


K lim nf — -1) >1, then the series ^ m„ of positive terms 

\««+i / „To 

convergent. 

If lim n(— -1J <1, then the series "^Un of positive terms is 

»-♦- \m»+i / 


divergent. This test frequently settles the doubtful case when 



lim ^ = 1. 


6^ Series of Arbitrary Terms. It follows from Property (C) 
of 61 that the theorems of Secs. 62 and 63 are applicable to 
series all of whose terms are negative. It will be assumed in 


this section that the terms of the series an are arbitrary real 

n —1 

numbers, and it will be seen that the behavior of such series is 
vastly different from that of series whose terms maintain the 
same sign. 

The following theorem, which is basic in all subsequent con¬ 
siderations, is a restatement of the theorem of Sec. 5 on sequences 
phrased in the language of infinite series. 

Theorem. A necessary and sufficient condition for the conver¬ 


gence of a series ^ an is that for any e > 0, one can find a positive 

n — l 

integer N, depending on €, such thaJt 


|5n+p — 8n\ = l^n+l + an+2 + ‘ + «n+pl < 

for n ^ iV and every integer p ^ 1. 

It should be carefully noted that the meaning of the inequality 

|an+l + an+2 + • • • + fln+pl < 


is that the sum of any number of terms of the series V an, begin- 

n-l 

ning with an+i, must remain less than a preassigned number 
€ > 0, so long as n ^ N. 
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The infinite series 

•e 

fln+l + a«+2 + • • • + On+p + • • • = 2/ 

Jfc»n+1 

obtained from the given series by discarding the first n terms, 
is called the remainder after n terms and is denoted by the symbol 


fn. Thus, if the sum of the series ^ is denoted by S, then 

jfe-i 

8 n + Tn — S, or S — Sn = rn, 

and it is clear that represents the error in approximating the 
sum S of the series by the sum Sn of n terms. The problem of 
calculating the actual value of the remainder rn (and, hence, 
that of the sum S of the series) is, in general, an exceedingly 
difficult one. However, in many instances it is possible to 
obtain an estimate of the magnitude of the remainder without 
determining its actual value. This is illustrated in the following 
the^m, which is due to Leibnitz. 

s^y^heorem on Alternating Series* A series whose terms are 
aUemately 'positive and negative and such that their absolute values 
form a monotone null sequence is convergent. The absolute value 
of the remainder after n terms of such a series does not exceed the 
absolvie value of the (n + l)st term. 

In order to prove the theorem, consider the partial sums 


S2n = Ul — O2 + Us “■ * • ' — 02n 

and 

^2M-2 = 82n + (02n+l n2n+2). 

By hypothesis the terms are monotone decreasing, so that the 
quantity in the parenthesis is positive. Hence, 


SO that the partial sums of even orders form an increasing 
sequence. On the other hand, 

S2n = Ol ““ (02 ““ Os) (04 — Oj) — • • • — (a2fi^2 ““ 02a-l) — Oani 
and, since the quantity in each parenthesis is positive, 

S2n < Oi. 
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This states that the increasing sequence {sjn} is bounded^ and 
hence, it must converge to some value S. But 

= «2n + CL2fi+l, 


lim S 2 n +1 = lini 82 n + lim a 2 n+l. 

n-+ • n~> • n—> • 

Since the terms of the given series form a null sequence, 

lim as*+i = 0, 

so that the partial sums of even and odd orders tend to the same 
limit S. 

It remains to show that 

|r„| < |o»+i|. 

Note that if n is even, then 

Tn = — (fln+S (^1*4-4 ~ • 

< 

If n is odd, then 

Tn == ““Un+l + ^n+2 Un+S + * * * , 

SO that 

— Tn = Un-fl ““ (®n+2 "" ~ (®n4-4 ~ Un+s) —- • • * 

< On+l. 

Thus, 

|r»l < lOiH-ii, 

which completes the proof of the theorem. 

A This theorem enables one to establish easily the convergence 
^f an alternating series, since all that is necessary to show is that 

(а) |an+il < l«nl, for all n ^ m, 

(б) lim Gn == 0. 

n-+ • 

Example 1. The series 


1 _ 1 + 1 _ 

2^3 


+ (-1)-^ + 


is convergent since lo*+il < lo»l for all n, and lim o» = 0. The 

n--> «o 

remainder tdter 1000 terms, riooo < Kooi> so that the conver¬ 
gence is very slow. 
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! 

/Example 2. The series 


/ 


^ — Z + ^ — . . . 4. 4 • • • 

2 4^6 8^ 2n^ 


1)1^ lom-il < lonl for all n, but it is divergent since lim a» ^ 0. 

n—» • 

1 1,1 ,1 

22 + 3 32 + 4 42 

is alternating, and lim an = 0, but it is divergent. Why? 


Example 3. The series 2 “^ + 3 “"q 2 +Z"“I 2 + 


66•^^b^ute Convergence. The series ^ an is said to converge 


n —1 


absolvtely if convergent. The convergent series which 

n — l 

do not converge absolutely are called conditionally convergent 
series. 

The fact that a series may converge in the ordinary sense but 
fail to converge absolutely can be seen from the following simple 
example. It was just shown that the series 

is convergent, but the series of absolute values is the harmonic 
series , 

+ • • • 

which is known to diverge. 

Theorem* A series ^an is convergent if th e series of absolute 

n-l 

ee 

values ^ lo„| is convergent. 

" n«l 

Since the given series is known to converge absolutely, one 
can find a positive number N, such that 

|o»+l| + |On+*l + • * • + |ffln+p| < «, 

whenever n N, and for every positive integer v. But 
la«+i + OiH-» + • * • + o«+p 1 ^ lon+il + |o«+*l + • • • + ; 



§66 

hence, 


INFINITE SERIES 


237 


|an+l + an+2 + * • * + €Ln+p\ < €, 

«e 

which is the criterion for convergence of the series ^ an- 

n —1 

00 

Inasmuch as the series ^ \an\ is a series of positive terms, the 

n — l 

tests developed in Secs. 62 and 63 can be used to establish the 

00 

absolute convergence of a series an. In particular, the tests 

n —1 

of Cauchy and d’Alembert can be phrased as follows: 

00 

Root Tpst. If the terms an of the series an from some value 
of n^r mard s atisfy the inequality 

V^lanl r < 1, 

then the given series converges absolutely. 

00 

Corollary. If lim = r < 1, then the series is 

n—► 00 

n-~*l 

absolutely coiw^ent. 

Ra&^/Test. If the terms an of the series ^ Un, from some value 


of n onwardy satisfy the inequality 


^ r < 1, 


then the given series converges absolutely. 

00 

"^orollary. If lim = r < 1, then the series ^an is 

absolutely convergent. 

It was shown above thaV a series may be convergent, but 
not absolutely convergen^ If, however, 

^ ^1 or ^ 1, 
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then ttn does not tend to zero, so that the tests of Cauchy and 
d'Alembert can be used also to establish the divergence of alter¬ 
nating series. 

As an illustration, let it be required to determine the range of 
values df^for which the series 



2 + T" 




is convergent. 

Now, the test ratio is, 


and hence, 


Un-H 

an 


ajn+l 

n + 1 

— 

n 


'n + 1 


K1 






Un-t-l 

fln 


|*|. 


Therefore, the series converges for all |a:| < 1 and diverges for 
all |a;l > 1. When a; = ±1 the test fails, but substituting 
x = 1 in the series gives 




which is convergent. Setting x = — 1 gives 


- 


which is divergent. Thus, the series converges whenever 
— 1 < X ^ 1. 

Series that converge absolutely possess some remarkable 
properties that are not shared by c onditi onally convergent series. 
It will be shown in the next section that the sum of an absolutely 
convergent series is independent of the order in which the terms 
of the series are added, but that this is not the case if the series 
converges cdhditiDnaily. In fact, by suitably rearranging the 
terms of a conditionally convergent series, the resulting series 
can be made to converge to any desired value, or even made to 
diverge. This striking behavior of conditionally convergent 
seri^ is illustrated by an example, and the reader will have no 
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difficulty in constructing a general proof along the lines of the 
example. 

jConsider the series 

(66-1) + ^ n + ■ ' ‘ • 

The fact that the sum of this series is less than 1 and greater 
than can be made evident by writing the series as* 

(I - H) + (Vs-y4) + {H-H) + - •. 

which shows that Sn > M for n > 2; on the other hand, the given 
series can be written as 

1 - (K - M) - (K - M) - • • • , 

from which it is clear that Sn < 1 for n ^ 2. 

Now if the series 

(65-2) (1 _ H - K) + (H - M - H)-+ (H-Ho- Ka) 

+ • • • 

is formed by an obvious rearrangement of the terms of (65-1) 
then the series (65-2) converges to only one-half the sum of the 
series (66-1). For, adding the first two terms in each parenthesis 
of (65-2) gives 

+ + (Ho -H2)+--- 

= H(i - H + H - H + H - • • • ). 

It will be shown next that it is possible to rearrange the series 

1-H + H-H+• • • , 

so as to obtain a new series whose sum is equal to 1. The positive 
terms of this series in their original order are 

1, H, H, H, • • • . 

The negative terms are 

-H, -H, -H, -H, • • • . 

In order to form a series which converges to 1, first pick out, in 
order, as many positive terms as are needed to make their sum 
equal to or just greater than 1, then pick out just enough negative 


* It will be seen in See. 76 that the sum of this series is log. 2. 
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terms so that the sum of all terms so far chosen will be just less 
than 1, then more positive terms until the sum is just greater 
than 1, etc. Thus the partial sums will be 

Si = 1, 

= 1 — H — 

8, = 1-H + H + H^ 8 ^ 0 , 

s» = i — + M + = ^J4o, 

8t=1-H + H + K- J4 + H + ^ = 

*8=1 — + M + + K + K — M = 


It is clear that the series formed by this method will have a sum 
equ^to 1. 

w. Properties of Absolutely Convergent Series. 

Njilieorem 1 (Commutative Law of Addition for Series). The 

rearrangement of the order of the terms in an absolutely convergent 
series does not alter the sum of the series. 

The theorem will be established first for a series of positive 
terms. Let the series 

(66-1) Ox + 02 + <*8 + ■ * * + o» -|- • • • 

of positive terms be convergent to the sum S, and denote its 
nth partial sum by s„. Suppose that the terms of the series 
(66-1) are rearranged in any way to give a series 

(66-2) bi -1- 62 + ba + • • • + + • • • , 

and denote the mth partial sum of (66-2) by s'^. Inasmuch as 
every term of the series (66-2) appears somewhere in the series 
(66-1), and since (66-1) is convergent, it is possible to find a 
positive integer N such that «», for n > N, will contain all the 
terms appearing in and some others which do ndt appear in 
«i,. Then 

«:;<«»< S. 

It appears that the partial sums are boimded, and since 
the sequenc^Xt} increasing, it must approach some limit, say 

(66-3) S' ^ S. 

It rmnains to demonstrate that S' and S are equal. This can 
be shown by reversing the point of view and regarding the series 
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(66-1) as some rearrangement of the series (66-2). It was just 
shown that (66-2) has a sum S'. Therefore, for a sufficiently 
large m, will contain all the terms appearing in the partial 
sum 8». Hence, 

Sn < si < S', 

and, since lim s„ = S, it follows that 

n—* •# 

(66-4) S ^ S\ 

A comparison of (66-3) and (66-4) leads to the assertion that the 
inequality sign cannot hold, so that 

S' = S. 

Consider next an arbitrary absolutely convergent series 

go 

On, and denote its sum by S. Form the series 

n-l 

«e 00 

(|a„| + an) and (l®»l “ ®")- 

n*l n-*l 

Each term of these series is positive or zero, and they are conver¬ 
gent since |a„| ± an ^ 2\an\- Now the difference of these series is 

00 oe 00 

(66-6) ^(lo„| -f an) - 2^(|a„| - o„) = 2^a„ = 2S. 

n»l n—1 n-l 

Since both the series in the left-hand member of (66-5) are 

independent of the arrangement of the terms, their difference 
00 

2 Un is likewise independent, and this establishes the theorem. 

n — 1 

00 

f CoroUax^ 1. // ]^an is absolutely convergent, then any ^*sub- 

n — 1 

series" formed from it by deleting any number (finite or infinite) of 
terms is absohddy convergent. 

This follows directly from the foregoing since the partial 

sums of the subseries are bounded. 

00 

Corollary^. If ]^a, is an absolutely convergent series, and if 

n — 1 

ilf„ Jif,. • • • , M,, • • * is any sequence of quantities whose 
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numerical values do not increase indefinitely, then the series 
aiMi + otMt +•••■+ + • • • 


is absolutely convergent. 

This follows upon the application of Theorem 2, Sec. 62. 
Example. Consider the series 


cos X 
1 * 


cos 2x 


+ 


cos 3x 
3* 


This series is absolutely convergent for all values of x because the 
series 


1 - 1+1 _ 

1* 2* ^ 3* 

is absolutely convergent and the numerical value of cos nx never 
exceeds unity. 

•0 «0 

Theorem 2. If Un and ^ Vn are any two absolutely convergent 

n-l n—l 

series whose sums are U and V, then they can be multiplied like 
finite sums to form the series 

(66-6) “h UiVj "H UtVi -|- Uii>» -f- UtVt UtVi 

+ UiVn + -!-•••+ Mn»l + * * ’ , 

which converges absolutely and whose sum is UV. 

It is convenient to display the terms of the product series 
in t ie form of a rectangular array of numbers 


UiVi 

J “i"* 

j UiVt 

.... UiVn 





U2VI 

U2V2 

J U 2 Vz 

.... U 2 Vn 





UzVi 

U9V2 

1 

.... UaVn 









UnVi 


UnVi 

• • • • UgJ)n 


from which it is seen that the terms entering into (66-6) appear 
in the diagonals of the array followed from top to bottom. It 
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will suflBice to show that any series formed from this array, in 
such a fashion that each term UiV^ of the product appears once 
and only once in the series, is convergent absolutely. Any other 
series, and in particular (66-6), can be obtained from it by a 
rearrangement of terms. It is convenient to consider the series 
formed from the array by following the boundaries of the squares 
indicated by dotted lines, namely, the series, 

(66-7) UiVi -f- U 1 V 2 “f" U 2 V 2 “I” U 2 V 1 -f- UiVt 4“ uiVz 4- UzVz 

4 ~ UzV2 + UzVi 4 - • • • 4 - UiVn + UzVn 4 " U^Vn 4 “ ’ * ' 

4 “ UnVn 4 “ UnVn-1 4 “ * * * 4 “ 4 “ * * * • 

•0 00 

It is assumed first that all terms in the series Un and 2) 

n —1 n — l 

are positive. Let Sm denote the mth partial sum of the series 
(66-7), and Un and Vn the nth partial sums of the series Un 

n-l 


and respectively. Then 

fi«1 

(66-8) [7,7, :S 8„ ^ 

so long as n* ^ OT ^ (n + 1)*. But 

lim [7,7, = Urn U^iVn+i = [77, 

fi--+ « n—♦ "0 

and it follows from (66-8) that 

lim = UV. 


Next let the series ^ Un and ^ Vn be any absolutely convergent 

n-l n-l 

series and form the series of absolute values 

m « 

(66-9) 

n—1 n-l 

The product, of the type (66-6), of these series, 

<• 

Ittifil + + l«iOxl + 1«1»»I + + IttjOil 
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is convergent, since each term of the series (66-9) is positive 
and it was shown that the product of such series is convergent. 
This establishes the absolute convergence of (66-6). 

As above, let be the mth partial sum of the convergent 
series (66-7), some of whose terms may be negative, and denote 
the limit of as m —♦ oo by S. Since 

lim Sfn = S 

n—♦ 00 


is independent of the manner in which m 
values 


Then, 

(66-10) 

But, 

and 


P, 2*, 3*, • • • , n*, • 
lim s„« = S. 

n—* 00 

Sn* ~ UnVnt 


00 , let m assume the 


(66-11) lim Sn* = lim UnVn = UV. 

n—» 00 n-+ 00 


A comparison of (66-10) and (66-11) shows that the sum of the 
product series (66-7) is 

S = UV. 


The particular form (66-6) of the product of two series is 
called the prodwt of Cauchy, and it derives its particular impor¬ 
tance from a consideration of the products of the power series 
discussed in Chap. VIII. It may be remarked that the condition 
enunciated in Theorem 2 is sufficient, but by no means necessary. 
If the series are conditionally convergent, the product of the two 
series depends on the particular arrangement of the terms in the 
product series. However, it was shown by Abel that if the series 


Un and ^ Vn are convergent and have for their sums U and V, 

n — l n — 1 

then if the Cauchy product (66-6) is convergent, its sum is 
necessarily UV. Mertens has shown that if one of the two 


convergent series ^Un and is convergent absolutely, then 

n-l n-1 
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Cauchy's product converges to UV. The proofs of these 
assertions of Abel and Mertens are omitted.* 

Example. The geometric series 


(66-12) /S = 

n —0 

converges absolutely if jr] < 1, and its sum is S = — 

Hence, the product of the series (66-12) by itself, namely, 

(1 + r + + • • • +r^ + • • • )(l + r + + • • • 

+ + •••) = 1 + 2r + + • • • + nr^-^ + * • • 

1 

IS convergent to 

PROBLEMS 


1. Prove that 2) converges absolutely for all values of a so 


long as |r| <1. 


S COS TlCl 

(l)n - jg absolutely convergent for all values 

n* 


of a, 

3. Show that the series 


C V3 Va) (Vs V7 Vi) (V9 

formed by rearranging the terms of the convergent series 

i__L + _i_L + ... 

V2 V3 Vi 

is divergent. 

HirU: Note that the general term of the given series, 


1 

\/4n — 3 




* See Knopp, K., Theory and Application of Infinite Series, English ed., 
p. 320. 
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is positive and greater than 

i_ ^ _ A _ 1 \ 1 

\/4n •\/4n \/2n \ \/2/\/n 

4. For what range of values of x do the series given below converge 
4 bsoIutely: 

<“>'“31 + 61 -< 

/rx _*1. . _... 

3 • 6 6 • 7 ’ 

, . * X‘ , X* 3!* , 

2 2 • 2* 3 • 2* 4 • 2‘ ’ 

(d) 10a: - 10*x» + 10**» - • • • ; 

, . sin a; sin 8x , sin 5x 

—^ + -5i -^ 

6. Form the Cauchy products of the series (a) and (6) and the series 
(c) and (6) in Prob. 4. 

6. For what values of a; is thesSeries 


X 

x + 2 


-(^)‘+(^y- 


absolutely convergent? 

7. For what values of x is the series 


2x 


+ 


l/ 2x Y 2* Y 

2\a; + 4/ 3V + 4/ 


X + 4 

absolutely convergent? Ans. — ^ < x <4. 

Double Series. Consider an infinite array of numbers 

ck/TT 


j = 1, 2, 3, • • 

• ), arranged in the form of a table 

au 

Ol2 

Oi8 

Oi4. 

021 

022 

028 

024 . 

Osi 

082 

088 

084 . 

041 

042 

048 

O44. 


Onl OnS On* ®n4 
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where the first subscript on Oij denotes the row, and the second, 
the column in which the element Oij appears. 

One can form the sum of mn terms of the array, 


Thus, 


m n 

Smn = 5) 5) 

3 4 3 

584 = 2 ) 5 ) ^ + fltS + CLiA) 

i -1 1 t»1 

= 011 4" Oi2 + Oi8 + 014 
+ 021 + 022 + 023 + 024 
+ asi + 082 + 038 + 084. 


It may happen that 


lim Sfnn = S, 

m-+ to 
n—* to 


where m —► oo and n—^co independently of one another. In 
such a case the symbol 



is called a convergent double series. 

A reference to the preceding section shows that the study 


of the product of two series Un and ^ Vn can be reduced to 

/ n -1 n -1 

that of the study of a double series whose terms are o*/ = UtVj. 

W. Series of Functions. Uniform Convergence. The 
remainder of this chapter is concerned with the study of series 
whose terms are functions of a real variable x. A series of 
functions of z 


(68-1) ui(z) + u^ix) + • * • + Un{x) + • • • 


will be denoted by the symbol ^Un{x)y and it will be assumed 

♦' n —1 

that the functions Un{x) are defined in the interval (a, h). 
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If X in (68-1) is assigned some definite value X\, there results 
a series of constants which may converge. If the given 

n»l 

series is convergent for every value of x in the given interval 

(a, h)j then it is said to be convergent in the interval (a, h), 
00 

A series ^Unix), convergent in (a, 6), defines a function of x 

n-»l 

in that interval, which will be denoted by the symbol S{x). 

00 

The sum Sn(a:) of the first n terms of the series ^Unix) is called 

n-1 

the nth partial sum of the series, and the statement that the 
series converges for a given value of x, say x = Xi, means that 

(68-2) lim Sn(iCi) = AS(a;i). 

n-+ « 

The definition of convergence (68-2) can be stated more explicitly 
as follows: 

«e 

Definition. The series Un{x) is convergent for a given value of 

n — 1 

X if for any € > 0 one can find a positive integer N such that for 
all values of n ^ N 

l<S(a:) - s«(a;)| < «. 

00 

If the sum of the terms of the series ^Un{x) beginning with 

n — l 

Un+i(x) be denoted by r»(a:), then 

r»(x) S S(x) - 8„(x) = Un+i(x) + Un+ 2 (x) + ' ’ ' , 
and the requirement that 

|iS(a:) — s„(a;)| < c 
is equivalent to the statement that 


|r«(a:)| < «. 
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Thus, the assertion that the series Un{x) is convergent for a 

n- 1 

given value of x = Xi means that 

lim r„(xi) = 0. 

n—» « 

It should be noted carefully that the definition of convergence 
just given is concerned with convergence at a given point x = Xi 
of the interval (a, 6), so that the number N appearing in the 
definition depends not only on the magnitude of e, but also 
on the choice of the point a; = Xi in the interval. To illustrate 
this important remark, consider the series 


(68-3) 


X + 1 


+ 


+ 


(x + l){2x + 1) ^ {2x + l)(3a: + 1) 

. X 


+ 


[(n - l)x + l](na; + 1) 


+ 


in the interval 0 ^ x ^ 1. 

The nth term of this series can be written as 

X 1 


[(n — l)x + l](nx + 1) (n — l)x +1 nx + 1 
so that (68-3) can be written in the more convenient form 

0 - JTt) + (jTl - 2 ?Ti) + • • ■ 

+ { _ ! _ + . .. 

\(n — l)x -f 1 nx + 1/ 

It is clear from (68-4) that the sum s„(x) of n terms of (68-3) is 

1 nx 


5n(x) = 1 - 


nx + 1 nx + \ 


Hence, 


Um Snix) S Six) = lim —v = 1, 

n—► • n—> «o J. 


if X 0. 


Thus, if X 7 *^ 0, 

Vnix) * Six) - 8„ix) = 1 - —^ ^ 


1 

nx + 1 
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Now let it be required to determine the magnitude of N, 
corresponding to a prescribed t, such that for all n ^ iV 

lrn(i)l < e. 


- TUTl' 


the condition lr»(a:)| < « becomes 


nx + 1 


Solving for n gives 
( 68 - 6 ) 




from which it is clear that N depends not only on c, but also 


on the magnitude of x. 


Thus, if € = 0.01, (68-5) gives n > —; 

X 


and for x = N can be chosen to be 199. If c = 0.01 but 

X — N must be at least 4 • (99) + 1 = 397. It is clear that 

if € is fixed and x is allowed to assume values nearer and nearer 
to zero, then the value of N must be chosen larger and larger. 

The series (68-3) converges for all values of x in the interval 
0 ^ X ^ 1, but it is impossible to find a single number N which 
will satisfy the inequality (68-5) uniformly well, that is, for every 
value of X in the interval (0, 1). However, there are series of 
functions of x for which it is possible to find one number iV, 
which does not depend on the particular choice of x in the interval 
and thus depends on € alone. 

An example of such a series is 


( 68 - 6 ) = + 


2x2 \ 

+ 2x 1 -f- X/ * 

^ nx2 _ (n — l)x2 \ 

y^l + nx 1 + (n — l)x/ 


where x is assumed to lie in the interval 0 ^ x ^ 1. Obviously 


1 + nx 
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and 

S(x) = lim «,(a:) = lim , j_ — = x. 

n—♦ «8 n—♦ «o 1 T“ 

Consequently, 

r.(x) . Si.) - >.i.) 

The requirement that rn(x) < e is, in this case, 

Y—, - < €• 

1 +nx 

Solving this inequality for n gives 
(68-7) n > - - “ 

€ X 

The inequality (68-7) shows that N again is a function of 
both 6 and x, but there is an important distinction in the char¬ 
acter of the inequalities (68-6) and (68-7). If € = 0.01 and 
a; = n > 100 — 2 = 98, so that N can be chosen to be equal 
to 99. If € = 0.01 and x = then n > 100 — 4 = 96, and 
N may be any number greater than 96. If € = 0.01 and x = ^, 
the least value of N is 99. It is clear that N remains hounded, 
regardless of what value of x is chosen in the interval (0, 1), for 
N = 100 will satisfy the inequality (68-7) with € = 0.01 
uniformly well for 0 ^ x ^ 1. 

Thus, it is seen that the reason for the difference in the behavior 
of the two series is that for the first of them N does not remain 
bounded (c fixed) when x is allowed to assume various values 

in the interval, whereas in the second case the choice of iV = i 

will serve uniformly well in the interval (0, 1). This leads to an 
important definition. 

00 

Definition of Uniform Convergence. The series 

n-l 

defined in the interval (a, 6), is uniformly convergent in that interval 
if, for any « > 0, there exists a number N, indeTpendent of the value 
of X in (a, b), stick that 

. \Six) - «,(x)| < €, 


for dU values of n ^ N. 
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It should be noted carefully that the concept of uniform 
convergence is connected inescapably with the , interval of con- 
vergence. The reader wHTprofit'^rfeatly by proving that the 
series (68-3), which was shown to be nonuniformly convergent in 
the interval (0,1), is uniformly convergent in the interval (^, 1). 
In the latter interval the function N(x) is bounded [see (68-5)], 
so that one can specify a single number iV depending on e only 
not on the particular choice of x in the interval ()^, 1). 
~\b9. Geometric Interpretation of Uniform Convergence. A 
geometric interpretation of the uniform and nonuniform con¬ 



vergence of series may help to crystallize these important con¬ 
cepts. The graph of the partial sum s„(x) of the convergent 
00 

series iS(a:) = '^Unix) may be called the nth approximation 

n — 1 

to the curve y = S(x). 

If the series is uniformly convergent, then the statement that 

( 69 - 1 ) |r«(a:)| s |S(x) - s„(a:)| < t, 

whenever n ^ N and for all values of x in (a, b), can be written 
as follows: 


S(,x) — t < 8n(x) < S(x) -I- e. 

It follows from these inequalities that the graphs of the approxi¬ 
mating functions y = 8„(x) for sufficiently large values of n 
can be made to lie between the graphs of y => S(x) -f- c and 
y — S(x) — e for all values of * in (o, 6) (Fig. 67). 

In the case of a nonuniformly convergent series it is impossible 
to enclose the approximating curves in a band of width 2c about 
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the graph of y = S{x), To be sure, for any particular value of 
X, say X = xif the graph of y = 8n(x) can be made to lie arbi¬ 
trarily near y = S{x) in the neighborhood of that point, so 
that the inequality 

|/S(xi) ~ Sn(xi)l < e 

is satisfied. 



In the specific examples of Sec. 68 the series (68-3) is of this 
second variety. The graph of S{x) is a straight line 

y = S{x) = 1, if 0 < X ^ 1, 
and 

S{0) = 0. 


The approximating curves 


y = 8n{x) = 


nx 

nx + 1 


are shown for several values of n in Fig. 68. All of the approxi¬ 
mating curves pass through the origin and approach the line 
y = 1 asymptotically. For any fixed value of x, say x = xi, 
in the interval (0, 1), it is possible to find a curve y = Sn(x) 
which will lie as close to y = /S(xi) as desired; but it is obvious 
that one ctonot enclose the approximating curves in a band 
of width 2c no matter how large a value of n is chosen. 
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The behavior of the series (68-6) is vastly different (see Pig. 
69). The graph of y = S(x) is the straight line y = x, and 
the graphs of 


y = «,(*) 


nx^ 

1 + nx 


for sufficiently large n can be made to lie entirely within the 
strip bounded by the lines y = x ± e. 



The reader will find it instructive to examine carefully the 
series 

22a: 


(69-2) 

/ 3 % 2 *® \ 

Vl + 3’a:* 1 + 2*xy 


+ 


for which 


•»(*) — 


n^x 


1 -|- n*x* 


Hence, S(x) = 0, which is a continuous function for all values 
of X. The graph of y = 8{x) is the entire x-axis, y = 0. The 
graphs of y = Sn(z) for n = 3, 5, 10 are indicated in Fig. 70. 
The approximating curves have peaks in the neighborhood of 
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X — 0 which grow higher with increasing n. Since y = Sn(x) 
cannot be made to lie within the strip bounded by the lines 
2 / = ±€, it is clear that the convergence cannot be uniform. 
However, if the study of the series is confined to any interval 
which does not include x = 0, say 0 < 5 a; ^ 1, the series will 
be found to converge uniformly to the value 8(x) = 0. 

This illustration shows that the sum S(x) of the series may 
very well be a continuous function even when the series represent¬ 



ing the function is not uniformly convergent. However, a 
discontinuous function cannot be represented by a uniformly 
convergent series of continuous functions in the neighborhood 
of the point of discontinuity (see Sec. 70). 

PROBLEMS 

1. Show that 

_ 1 __ 1 _ 

x + I (x -h l)(x + 2) (x + n - l)(x 4- n) ’ 

1 

X + n 


for which %*(x) 
0 ^ X i J 


is uniformly convergent in the interval 
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2. Show that the convergence of 

1 + X + + X* + • • • + x^ + • • • 

is not uniform in the interval (0, 1), but is uniform in the interval 

(0, H). Prove that if |rn(a;)| < €, then n > -£) _ 

log X 

3. Show that 

(1 — «) + a;(l — x) + x\l — x) + * • • 

is not uniformly convergent in the interval 0 ^ x < 1. 

4 Discuss the nature of the convergence of the series 


« 

2 / nx 
\1 + n^x^ 

n*l 


(n — l)x \ 
1 + (n - l)*xv’ 


TtX 

for which 8n(x) = ———• Show that S(x) is continuous but that 
1 + n x^ 

coi^ergence is not uniform in any interval containing the point x = 0. 

^0, Properties of Uniformly Convergent Series. In formulat¬ 
ing the definition of uniform convergence, no assumption was 
made regarding the continuity of the terms of the series. It 
will be assumed in this section that the functions Un{x) entering 


in ^Un(x) are continuous functions of x in some interval (a, b). 

n — 1 

It is clear that the partial sums Sn(x), being the sums of a finite 
number of continuous functions Wt(x), will be continuous. 
However, the sum ^(x) of an infinite series of continuous- func¬ 
tions need not be continuous. This fact is evident from the 
discussion in the preceding section in connection with the series 
(68-3). The question naturally arises: Under what circum¬ 
stances will a series of continuous functions define a continuous 
function? An answer to this question is given by the following 
theorem: 

Theorem 1. Let 

Ui(x) H- U 2 (x) + • • • + Unix) + • • • 

he a aeries such that each Unix) ia a continuoua function of x in 
the interval (o, b). If the aeries is uniformly convergent in ia, b), 
then the sum of the aeries ia also a continuoua function of x in 
(a, b). 
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Denote the sum of the series by S{x); then it is required to 
show that* for any value of x, say x = xi, in the interval (a, b), 

15(11 + h)- 5(x,)I < «, 

whenever |A| < 5. Now 

15(xi + h)- 5(x,)l = |[S(xi + A) - Snixi + A)] 

+ [Sn(2l + A) — S„(Xi)] + [s„(Xi) — 5(Xi)]l. 

Since the absolute value of the sum is not greater than the sum of 
the absolute values, one can write 

(70-1) |5(xi + h)- 5(x,)| ^ |5(xi -f- A) - s„(xi -f- A)| 

+ |Sn(Xl + h) — S„(Xl)I + |Sn(Xl) — 5(Xl)l. 
00 

But, by hypothesis, the given series '^Unix) is uniformly con- 

n“ 1 

vergent, so that for any prescribed € > 0 one can find a number 
N such that 

(70-2) |«n(x) — S(a;)| < whenever n ^ Nj 

and (70-2) must be satisfied for any value of x in the interval 
(a, b). In particular, it must be true for x — Xi and for x = Xi + h, 
so that 


(70-3) 


ls.(xO - S(x01 < I 

|Sn(Xi -f- ^) — S(Xi -1- /l)| < 


Having chosen N so that the inequalities (70-3) are satisfied, 
choose a number 8 so small that for a fixed n ^ N 


(70-4) |5n(xi + h) — Sn(a:i)l < whenever 1A| < 5. 

This is always possible since Sn(x) is a continuous function. 
Substituting in the right-hand member of (70-1) gives 

|S(xi + A) - S(xi)l < ^ + I + I = «. if \M<i- 


• See Sec. 11. 
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But this is precisely the statement required for the proof of the 
theorem. 

It should be noted that the conditions of Theorem 1 are 
sufficient to ensure continuity. A nonuniformly convergent 
series may converge to a continuous function [see the series 
(69-2)1. 

Theorem 2. If a series of continiLOus functions 

Ui{x) -h U 2 (x) + • • * + Unix) + • • • 
converges uniformly to Six) in a ^ x ^ b, then 

J^Six) dx = dx + • • • dx 

+ * ' * » 

where a ^ a ^ b and a ^ ^ b. 

This theorem gives a sufficient condition for the integration 
of a series of functions term by term. 


By hypothesis the series ^Unix) is uniformly convergent in 

n-l 

the interval (a, b) so that for any € > 0, 

(70-5) \rnix)\ = \Six) - Sn(a;)l < €, for n^ N, 

and for every x in (a, 6). S(a;) and Sn(a:) denote, as usual, the 

sum of the series and the nth partial sum. It follows from 
Theorem 1 that Six) is continuous, and hence it is integrable in 
(a, b). Therefore, 

(70-6) jy(.x) dx - f^Sn{x) dx = f\^{x) dx, 

where a and /? are any two values of x in (a, 6). 

From (70-6) it is seen that 

^^Vnix)\ dx < tip ^ a) ^ tib — a), 

and, since 

(70-6) gives 

(70-7) |J[^S(*) dx — J^»n(x) dij < 6(6 — o), for N. 
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The inequality (70-7) states that the difference between the 
integral of the sum of the series and the integral of any partial 
sum «»(*) can be made arbitrarily small, provided that n N. 
But 

n 

dx 

t - 1 

n 

= dx, 

80 that (70-7) becomes 

n 

J^S{x)dx — ^ n ^ N. 

This inequality, however, states that 

CO 

(70-8) X**'^^*^ ^ 2X**“*'^*^ 

If the limit P in (70-8) is set equal to x, where a ^ x ^ b, 
then the series of integrals 

J[[*Wi(x) dx + dx + • ’ • + J^y^nix) dx + • • • 

converges uniformly to 

£s{x) dx. 

A nonuniformly convergent series, when integrated term 
by term, may or may not converge to the integral of the function 
defined by the series. For example, the series (68-3) was shown 
to be nonuniformly convergent in the interval 0 ^ x ^ 1. But 

The nth partial sum of (68-3) was found to be 

1 

nx -f" 1 


*,(*) = 1 - 
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and 

dx = J^‘(l - dx 

^ J _ log (n + 1 ) 
n 

Hence, 

lim r Sn(a:) dx = lim = i 

n-.«o Jo n-.-\ n / ^ 

so that in this case 


f^S(x) dx = 5) J^^Mn(a:) dx = 1, 

n —1 

despite the fact that the given series does not converge uni¬ 
formly. It is evident from this example that the condition 
enunciated in Theorem 2 is sufficient, but not necessary, for 
integration term by term. 

As an example of a nonuniformly convergent series that 

oo 

cannot be integrated term by term, consider the series ^Un(x) 

n— 1 

in the interval 0 ^ a; 1 whose nth partial sum 5n(^) is given 
by the formula 

Sn(ic) = nxe~^*\ 

In this case the sum S{x) of the series is 

S(x) = lim nxe”’‘** = 0. 

n—♦ *0 

Consequently, 

^^<S(a:) dx = 0 , 

whereas 

g—nas* I 

I Sn(«) dx = I dx -- 55 - 

Jo Jo « 0 

_ 1 - C-» 

2 



{70 

Thus, 


INFINITE SERIES 


261 


n-l 


dx = lim 

n-+ « 



Sn(ic) dx = lim 

n-> 00 



1 

2 * 


The fact that the series '^Unix), whose nth partial sum is 

n*»l 

8„(a:) = nxe~^^\ cannot be uniformly convergent can be seen 



from the graphs of the partial suras y — Sn(x) plotted for several 
values of n in Fig. 71. The peaks of the approximating curves 
y = Sn(x) grow higher and higher* with the increase in n, and 
since S(x) == 0, it is obvious that it is impossible to draw a 
band of width 2e about S(x) that will enclose all the approxi¬ 
mating curves y = s„(x) from some value of n onward. 

Theorem 3. If the series 


ui(x) + U 2 {x) + • • • + Un{x) + • • * 

* The reader will have no difficulty in showing that the maximum value of 

^1 V'n 

« —p=:* so that («»(a?))iiu«. == ~7=‘ 


«n(af) occurs when x 
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ts convergent to S(x) in (a, b), and if the derivative of each ««(x) 
is continuous in (a, b) and the series of derivatives 

u[{x) + + • • • + <(x) + • • • 

is uniformly convergent in (o, 6), then the series of derivatives 
converges to S'{x). 

Denote the sum of the series of derivatives by /(x). Then, 
since the series of derivatives is assumed to be uniformly con¬ 
vergent in (o, b), Theorem 2 permits this series to be integrated 
term by term so that 

00 so 

fy(x) dx = ^ 

so 

= 

where a and x are in the interval (a, b). Hence, 

Aj7(x) dx = ^[S(x) - S{a)] = S’ix). 

But /(x) is a continuous function, and therefore, * 

fix) = S'ix). 

This theorem provides only sufficient conditions for the 
differentiation of a series term by term. It is possible to prove 
the theorem under less severe restrictions. In particular, the 
requirement that the u'(x) be continuous is more severe than 
it needbe.f 

71.Jweierstra8s Test for Uniform Convergence. The impor¬ 
tance of the concept of uniform convergence is amply illustrated 
by the theorems of the preceding section, and it is natural to 
inquire under what circumstances a given series converges 
uniformly. A direct application of the definition of uniform 
convergence, leading to the determination of the functional 
dependence of N upon x and «, is likely to be exceedingly difficult, 
since it requires knowledge of the expression for the remainder 
of the series. There are numerous tests, of varying degrees 

* See Sec. 38. 

t See Knopp, K., Theory and Application of Infinite Series, p. 342. 
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of complexly, but the simplest of these is the test due to K. 
Weierstras^ which is commonly known as the Weierstrasa 
M-teat. ( 

Thee£i0m (Weierstrass Test). Lei 




Ui{x) + Uiix) + 


+ Unix) + 


be a aeriea of functiona auch that each Ui(x) ia a bo unded function 
of X in (a, 6). If there exiata a convergent aeriea of poathve conatanta 

Mi + M2+ • • • + Mn + • * ' 

auch that liii(x)l ^ Mi for all valuea of x in (a, b), then the aeriea 

Ui{x) + U2(x) + • * • + Unix) + • • • 


ia uniformly and abaolutely convergent in (a, b). 

In order to establish the theorem note that the series of M^a 
is convergent, so that 

Afn+l + Mn^2 + • • • + Afn+p < C 

whenever n N, and for all positive integers p. But each 
w<(x) is such that |wt(a:)| ^ Mi for all values of x in (a, 6); hence, 

(71-1) |Wn+l(a;)l + \Un-^2ix)\ + • • • + \Un+pix)\ < €. 

Since (71-1) is independent of the value of x in the interval 


(a, b)y the series ^Uiix) is uniformly and absolutely convergent. 

t —1 

It should be noted that the concepts of uniform and absolute 
convergence are entirely distinct and that they do not imply 
one another. The series may be uniformly convergent, but 
not absolutely convergent, and vice versa. 

Ejcamples. Consider the series 


sin X , sin 2x , 
jj T 2 * 


, sin nx , 
n* 


Since jsin nx\ ^ 1, the convergent series 

1.1. 1 a. . 

1* + 2* ‘ n* 

will serve hs an M series for the given series. Therefore, the 
given series converges uniformly in any interval (a, b), however 
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large. From Theorem 1, Sec. 70, it follows that the series 

- 9 — defines a continuous function S(x). Such a series 

may be integrated term by term in any interval to obtain the 
integral of S{x). But the series of derivatives 


cos X cos 2x . 

1 "1” Ck I 


, cos nx . 
n 


is not uniformly convergent. In fact,* it is not even convergent 
for X = 2fcir, where A; = 0, 1, 2, • • • . 

On the other hand, the series 


CO 

S,(x) = 2 


sin nx 
n® 


n-l 


upon differentiation term by term gives 




cos nx 
n^ 


n-l 


The latter series is obviously uniformly convergent so that the 
differentiation is legitimate and one is assured that 

S 2 ix) = S[{x). 


72. AbePs Test for Uniform Convergence. The test of Weier- 
strass possesses the advantage of great simplicity, but it is 
applicable only to a restricted class of uniformly convergent 
series, since every series to which the Weierstrass test is appli¬ 
cable is necessarily absolutely convergent. A more delicate 
test, essentially due to Abel, is of great practical and theoretical 
importance, especially in the study of power series. 

00 

Theorem (Abel’s Test). The series of functions 2^u»(a:) con- 

n-l 

verges uniformly in the interval a ^ x ^ bif the functions Unix) are 


♦ This series, however, converges to —log 
See Prob. 6, Sec. 105. 



in the interval 0 <x <ir. 
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of the form Unix) = dnfnix), where the constants an are such that 


the series ^an is convergent and the functions fnix) are bounded 

n- 1 

and 'positive and satisfy the condition* 

/n+l(x) S. fn(x) < M, 

for every n and every value of x in (a, 6). 

Let 

Sn = + ^2 + * * * + Onj 

^n +1 “i“ a>n +2 “f“ * * * “f” 

and 


Sn+p — Sn — Un +1 + Un +2 + 


I 




"f" * * ’ "f* ^n+pfn-t-p» 


Noting that 


one can write 


= an+m, if m > 1, 

§1 = On-^l) 


I^n+P ^n| I^n-f-lfn+1 ”1“ C^n+J5/n+2 ”f” * * * “f" ^n+pfn+p\ 

= Wjn+1 + (^2 — s[)fn+2 + ' ’ ’ + — S^-O/n+pl 

= Wlifn-^1 —/n+ 2 ) + Si(fn~h2 —/n-f- 3 ) + * * * + S'pfn+p\ 
^ l^ll(/n+l“"/n+2) + iS2|(/n4-2““/n+3)+ * * ’ +\Sp\fn+p- 

Denote the greatest of the numbers |s^|, (m = 1, 2, • • • , p), 
by k; then 


(72-1) \8n+p - Sn\ < fc[(/.+l - U 2 ) + ifn^2 


- fn+ 3 ) + * * * 

/n+p] = kfn+V 


The series of constants ^an is convergent; hence, for any 

n -1 

c > 0 one can find a positive integer N such that for all n ^ iV 
and for every positive integer m, 


|Sn-hm 5n| — l^ml ^ 

c 

* The proof goes through with obvious minor changes if the sequence of 
positive functions fn{x) is monotone increasing with n. 
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In particiUar, the inequality is true for the greatest of the ««, 
and it follows that 


Substituting this value of k in (72-1) and recalling that |/»+i| < M, 
gives 

|/S„+p — Sn\ < «, for all n ^ N. 

ee 

But N is independent of x, and therefore, ^Un(x) is uniformly 


convergent. 


PROBLEMS 


1. Test the following series for uniform convergence: 

(а) 1 + X cos a + cos 2a + x* cos 3a + * * * , |x| ^ < 1; 

(б) 10a; + 10*a;* + 10»a;» + • * • ; 
sin X sin 3x sin 5x 

(c) — + + • • • ; 

(d) ~ cos 2x — ~ cos 3x + -~ cos 4x — • • • ; 

2® 3® 4* 

, . cos 2x . cos 4x . cos 6x , 

—+ 1-5- + -W + ' ’ 




(ff) 1 - X +1* - x> + • • • ; 

X* X» X* 

(h) X ; 

(t) 1 + X + ^ + ^ + • • • ; 

2. Test the series of derivatives of Prob. 1 for uniform convergence. 




CHAPTER VIII 
POWER SERIES 


73. Power Series. The series of the form 

ao 

^o»a:" = Oo + aix + a*a:* + • • • + + • • • , 

n-0 

in which the coefficients of the powers of x are independent of 
Xy occupy an especially prominent place in analysis and are known 
as power series. The totality of values of x for which a power 
series is convergent is called the irUervol of convergence of the 
series. 

It is readily verified, with the aid of the ratio test, that the 
series 


l + a: + x*+ ••• ••• 

converges for all values of x such that lx] < 1, and diverges 
whenever |a;| > 1, while the series 

l+x+|j+. 

converges for every real value of x. 

Obviously every power series converges for x = 0, whatever 
the coefficients a» are. The fact that some power series may 
not converge for any value of x other than zero can be seen 
from a consideration of the series 


1 + a; + 2! z* 4* • • ' + n! as* + • • • . 

The ratio of the (n + l)st to the nth term of this series is 


“stl s. X* 

(n — 1)1®*"^ 


nx. 


and since |n*| increases with n for every ® ^ 0, the series diverges 
whenever |®| > 0. 
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The following fundamental theorem, due to Abel, furnishes 
information concerning the character of the convergence of 
power series. 


-J^eorem. If a power series is convergent for x = * 0 , 


n — 0 


then it is absolutely convergent for every value of x such that 
\x\ < [xo]. On the other hand, if the series is divergent for x = Xo, 
then it is divergent for every x such that |x| > |xo|. 


Consider first a series ^ anX^, which converges for some value 

n — O 

of X, say X = xo. Then, necessarily, UnX? —> 0 when n —► oo, 
so that there exists a positive number M such that 

|anX5| < M, for n ^ 0. 

But 


|anX"l 





and, for any x such that |x| < lxo|, 


Xq 


== r < 1. 


Accordingly, the series of absolute values, 


^ lanX^l = |ao| + |aix| + |a 2 X^| + • • * + lanX’*! + • * • , 
n — O 


is term by term less than the convergent geometric series 
M + Mr + JIfr* + • • • + il/r" + • • • , 


and hence, the given series ^ a^x** converges absolutely, 

n —0 

The proof of the second part of the theorem follows from 
the first part. For, assume that the given series diverges 
for X — Xo, and suppose that it converges for some value of x 
such that 1*1 > |*o|. Then, by the first part of the theorem, 
the series must converge for x ^ xo as well, which contradicts 
the hypothesis. 
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It is possible to establish, with the aid of this theorem, the 


existence of a number R such that 2) converges absolutely 

n-O 

for every x such that |a;| < and diverges for all x such that 
\x\ > R, However, instead of merely establishing the existence 
of Ry the actual determination of the value of R will be given 
in the next section. (This determination, of course, establishes 
the existence of R,) The number R is known as the radius of 
convergence of the series* and the interval ( —i?, R) is called the 
interval of convergence. 

74. Interval of Convergence. The theorem to be established 

in this section gives the exact determination of the radius of 

00 

convergence of the power series It follows from the 

n —0 

application of the root criterion of Cauchy, t that if 
(74-1) ^|anl|x| ^ r < 1, 


then the series ^OnX'^ converges absolutely for all values of x 

n-O 

satisfying the inequality (74-1). In particular, if the limit of 

V^|a„| exists as n —> oo, and if its magnitude is L, then the series 
00 

^ UnX” will converge for every x such that 

71=0 

(74-2) L\x\ < 1, 

and it will diverge whenever 
(74-3) L\x\ > 1. 


It follows from (74-2) and (74-3) that the radius of convergence 
R is given by the formula 


(74-4) 



* The reason for associating with the number R the term radius of con¬ 
vergence is that the region of convergence of a power series where x is a com¬ 
plex number is a circle of radius R. 
t See Sec. 62. 
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provided that L But if L = 0, the inequality (74-2) is 
satisfied for all finite values of x, so that in this case the interval 
of convergence is infinite. If L = oo, it follows from (74-3) 
that the series diverges for any x 0. Thus, if it is agreed, 

for the purposes of this section, to write q =• and — = 0, 

then the formula (74-4) will be applicable to all those series for 
which the limit L can be determined. 

As an illustration of the application of formula (74-4), consider 
the series 

(a) X + X* + X* ‘ ‘ 

and 



Since a, = 1 in (o), lim = 1, and the formula (74-4) 

n-* «o 

gives B = 1. In the case of the series (6), Otn = so that 
lim Consequently, the radius of convergence of 

n-* • 

(b) is 2. 

If one adds the series (a) and (b), there results the series 

(c) 1+ X + + . . . 

which certainly converges for all values of x such that |x| < 1. 
However, the limit of as n—» oo does not exist, since 

lim ■^|oj»| = and lim*"^|o 2 »+ii “ !• Formula (74-4) is 

n-4 «o n-* • 

not applicable in such a case, but it is recalled that every sequence 
of numbers has a uniquely defined upper limit, and it will be 
shown next that a generalisation of formula (74-4) enables 
one to calculate the radius of convergence whenever (74-4) 
is not applicable. 

nieorem. Let L denote the upper limit of the eequenee 


|oi|. Vl<*i|> • • • , • • • 
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then the radius of convergence R of the series ^ o„a:“ is given by 

n*-0 

the formula 

e = L = _ 

L nin \^|a»| 

Consider first the case where L = 0, so that /Z = «, If x 
is any fixed number not equal to zero, then 


2\x\ 


> 0 . 


Since the upper limit L is zero, there are at most a finite number 
of the v1[a^ that are greater than L + € = Consequently, 

one can find a positive integer p such that, for every n > p, 

or 

|ona:»| < 


Thus, the absolute values of the terms of the series 

n-O 

(for n > p) are less than the corresponding terms of the geometric 
00 

series ^2^ since x can be chosen arbitrarily large, it follows 


n-O 


that the given series converges for all values of x. 

Consider next the case when L is finite but not equal to zero, 
and let X be any fixed number such that 

|xl < 

Choose any number r between \x\ and that is, 

|x| < r < 


•See Sec. 7. 
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then, — > L, so that — = L t. Since only a finite number 
r T 

of the can exceed L + e, it follows that there must exist 

a positive integer p such that for every n > p 

or 

^ • ixi < M < 1. 

Thus, 

< -^ < 1- 


Again, the general term of the series ^ anX^ (for n > p) is leas 

n-O 

in absolute value than the corresponding term of the convergent 


- • Consequently the given series must 

n-O 

converge absolutely for every value of x satisfying the inequality 

1*1 < r. Since r can be chosen as near ^ as desired, the given 

Jj 

series will converge for every x such that 



A similar argument shows that if \x\ > then \anX^\ > 1, 
so that the series cannot converge for any x such that 



In the last possible case, namely, L = oo, the terms of the 
given series are unbounded if x 5 *^ 0. Consequently, the only 
value of x for which such a series converges is x = 0. 

In practice it is much easier to determine the radius of con¬ 
vergence with the aid of d'Alembert's test. If the limit as 


00 


of the ratio 


ttn+l 

an 


is defined, then it follows from d’Alem- 
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berths test that the series 
of X for which 


anX** will converge for those values 

n-O 


lim 

n—♦ • 


CLn+l 

an 


• la:| < 1. 


Therefore, the given series ^ a„pc^ will converge whenever 

n-O 

1^1 < — 

lim 

n—► • 

and it will diverge when 

> — 
lim ^ 

n—* *0 Un 

This permits the formulation of the following practical rule for 
the determination of the ihterval of convergence: 

«e 

Rule. If the series ^ anX^ is such that 

n — 0 

lim -^ = R, 

n—♦ « Un+l 

then the series converges in the interval —R < x < R, 

The discussion given above can be extended immediately 
to cover series in powers of x ~ Xo, namely, 



(74-5) ^an(x - Xo)^ 

n —0 

The substitution x' = x — Xo in (74-6) gives the power series 


n*0 

and if the'latter series converges for all values of x' such that 
\x'\ < r, then the series (74-6) will converge for all values of x 
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such that lx — Xo| < r. Thus, the interval of convergence 
of the series (74-5) has the point x = xo as its midpoint. 
Examples. The interval of convergence of the series 


i+.+ii+ 




is infinite since 


lim = lim = lim (n + 1) = oo. 

n—♦ • ®n+l ft—► • Tlrl n-+ • 

On the other hand, lim does not exist for the series 

n-»« An+l 


1 + X + 


+ **+ s + 


However, the sequence 

|a,|, VN, aJW, . . . , V^, . . . 

is, for this series, 

1, K, 1, , 

and it is clear that Tim = 1. Hence, the interval of 

convergence is — 1 < x < 1. 


PROBLEMS 

Determine the interval of convergence for the following series, and 
determine the behavior of the series at the end points of the intervals: 

^ 21 4! 61 ' ' 

(6) lOx + lOV + 10‘x* + • • • ; 

(c) 1 + X cos ^ + X* cos 2^ + • • • ; 

(d) X + 2Ix* + 3!x» + • • • ; 

(e) 1 + m* + — '-X* + ^ - 'x* + • • • ; 

. 1** . 1-3** . 


(g) — - — + — _ 

^M-2 3-4^5-6 

(A) 1 - 2x + 3x* - 4x» + 
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(0 1 + 




+ 


(i) - + —JC + —.X* + —x‘ + 
o o* o’ o’ 


76. Properties of Functions Defined by Power Series. The 

«a 

power series ^ anX^y whose radius of convergence is R, converges 

n-O 

for every value of x such that \x\ < R and, hence, defines a 
function of x in the interior of the interval ( —jB, R). What 
can be said about the properties of functions defined by power 


-R -Xo CL O b XoR 

Fiq. 72. 

series? Will such functions be continuous? Is it permissible 
to integrate and differentiate power series term by term? And 
if so, what can be said about the intervals of convergence of the 
resulting series? The answers to these questions furnish an 
explanation of the prominent role that power series play in 
analysis. 

Theorem 1. Lei R > 0 be the radius of convergence of a power 
00 

series ^OnX^; then this series converges absolutely and uniformly 

n — O 

for every value of x in any interval a ^ x ^ b which is interior 
to the interval ( —/?, JB). 

Inasmuch as the interval (a, b) is assumed to lie entirely 
within the interval (—i2, B), one can choose a positive number xo 
that is greater than \a\ and \b\ but less than R (Fig. 72). Hence, 
the interval (a, b) lies entirely within the interval (—xo, xo)y 
so that for any value of x in the interval (a, b) 

\anX^\ < \anX^l 

Accordingly, the series of positive constants 


« 

2la»*ol 

n-0 
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can be used as the Weierstrass Af-series to establish the absolute 

00 

and uniform convergence of the series ^ anX^ in the interval 

n-O 

(a, b). 

00 

Theorem 2. A power series 2) (^nX*^ defines a continuous function 

n—0 

for all values of x in any closed interval (a, h) which lies entirely 
within the interval of convergence of the given series. 

The truth of this statement follows from the preceding theorem 
upon recalling Theorem 1, Sec. 70. 

00 

Theorem 3. If the radius of convergence of the series OnX^ is 

n-O 

00 

jB, then the radii of convergence of the series ^ nanX^~^ and 


—obtained by differentiating and integrating the given 
n X 

n-O 

series term by term^ are also R. 

The proof of the theorem follows from the observation that 

Iim v^lnunl = Em ^ ^ ^ 


since both and ^ tend to unity as n increases indefi¬ 
nitely. 


Theorem 4. A power series may be differentiated and 

n-O 

integrated term by term in any closed interval (o, 6) which lies 
entirely within the interval of convergence of the given series. 

The validity of this theorem follows at once from Theorems 1 
and 3 of this section, upon noting Theorems 2 and 3, Sec. 70. 

76, Abel’s Theorem. None of the preceding theorems of this 
chapter furnishes information concerning the behavior of a 
power series at the end points of its interval of convergence. 

For example, the series 

(76-1) S\{x) 1 + X + + ••• +«**+ • •• 
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converges for every value of x interior to the interval ( — 1, +1) 
and diverges at x = ±1. 

The series 


(76-2) S,{x) =x + ^ + ^+ ■ ■ ■ + ■ ■ ■ 

It 6 n 


has the same interval of convergence as (76-1), but it converges 
at X = —1 and diverges when x = 1. 

The series obtained by differentiating (76-2) term by term 
is precisely the series (76-1), and the differentiation is legitimate 
so long as x lies in the interior of the interval (—1, 1). The 
series (76-1) defines a continuous function 


Si(x) 


1 


1 — X 


for every value of x such that |x| < 1. 
Since 

and 




(l-fx-fx^-f- • • • +x^+ • * ' ) dx = X + + * 

+ ^ + 

n 


one can assert that 


Szix) = - log (1 - x) 

so long as |xl < 1. 

It is important to note that the series (76-1) represents the 
function 


Si{x) 



X 


only for those values of x which are interior to the interval ( — 1,1), 
and it is not surprising that the equation 


1 — X 


= 1 -)- X + x^ + 


+ x** + 


gives a nonsensical result, if one substitutes in it formally x = — 1. 
On the other hand, the series (76-2) converges not only for every 
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value of X interior to the interval (—1, +1), but for a: = —1 as 
well. In the interior of the interval (—1, +1) the series con¬ 
verges to 

(76-3) S%ix) = - log (1 - *), 

and the question arises whether formula (76-3) is valid for 
X = — 1, so that one is permitted to write 

iSj(—1) l + J^ — + •• • = — log 2. 

A theorem, due to Abel, which will be established next, answers 
this question in the affirmative. 

ao 

Abel’s Theorem. If a power aeries whose radius of 

n —0 

convergence B is finitey converges cU x — R (or a: = —R) then it 
converges uniformly in the closed interval (0, R) (or (0, —R)). 

There is no loss of generality in assuming that the radius 
of convergence of the given series is unity. For, a substitution of 
00 

X = 22y in the series ^ OnX^^y whose radius of convergence is 72, 

n—O 

produces the series 


to 

n-0 

00 

where bn = B^Uny and the series bny^ converges in the interval 

n-O 

(- 1 , 1 ). 

Assume that = 1 is an end point of the interval of conver- 
00 

gence of the series and that the series of constants 

n-O 

Oo + Ol + <*2 + * • • + + * ' * 

is convergent. 

The function /.(x) ^ x” satisfies the conditions of Abel’s test 

00 

(Sec. 72) in the interval (0,1); hence, the series ^ o**" converges 

n-0 

uniformly in the interval 0 ^ x ^ 1, 
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The proof of the case when the series converges at x = — 1 
follows from the foregoing ii x in the given series is replaced by 
—rr. 

The theorem of Abel states that if the given power series is 
known to be convergent at one of the end points of the interval, 
then the interval of uniform convergence of this series can be 
extended to include that end point. Since a series of continuous 
functions that converges uniformly in a given interval defines 

a continuous function in that interval, it follows that the series 
00 

anX**, which converges at x = i2, defines a continuous function 

n-O 

S(x) in the interval —R<x^R. Furthermore, since S{x) 
is continuous at x = /2, it follows that 


lim S{x) = S{R) = Van/2". 

In the example (76-2) it was found that the series 

converges for X = —1. Moreover, in the interval —1 < x < 1, 
S(x) = - log (1 - *), 
and the theorem of Abel shows that 

lim S{x) = lim [ — log (1 —*)]=— log 2. 

at—► — 1 ► — 1 

But 

lim S(x) = S(-l) = -1 + ^ - + • • • . 

X —► — 1 

Hence, 

-log2= -l + M-M + K- ■ • • . 

77. Uniqueness Theorem on Power Series. 

00 so 

Theorem. If the power aeries ^ OnX" and ^ bnX^ both converge 

n—0 n-0 

in some intierval about the point x = 0 and have the same sum 
for every value of x in this inUrval^ then the two series are ideniicaL 



280 


ADVANCED CALCULUS 


$78 


By hypothesis 

(77-1) ao + a\X + a2X^ ^ ^ ^nX^ • • • 

= 6o + biX + h2X^ “h * * * "1“ bnX^ “h * ‘ * 

for all values of x in some interval (—r, r), and since the function 
f(x) defined by these series is continuous for every point interior 
to (—r, r), it is certainly continuous at a; = 0. 

Letting a; —» 0 in (77-1), there results 

do “ ^^0- 

Dropping do and 5o in (77-1) and dividing through by x gives, 
for a; 0, 

(77-2) di + a^x + daa:* + • • • = bi + b2X + b^x^ + • • * . 
Letting a; —> 0 in (77-2), there results 

ui = bi 

and 


q>2 “i" *4“ ^43/* -f- • • • = 62 4" bdX 4” biX^ 4“ * * * > 

for a; 7 -^ 0. 

A continuation of this process leads to the equality 

Un = bn 

for every value of n. 

This theorem asserts that one can equate the corresponding 
coefficients of powers of x on both sides of the Eq. (77-1). Fre¬ 
quently, this theorem is called the uniqueness theorem on power 
series because it shows that there is not more than one way of 
representing a given function f(x) in an infinite series of powers 
of a; in a given interval. For, if two different methods lead to 
two power-series representations of a given function, then the 
two series are necessarily identical. 

78. Algebra of Power Series. It was shown above that a 

power series dna?" converges absolutely for every value of 

n-O 

that lies within its interval of convergence. Consequently, 
it is permissible to rearrange the terms of the power series in 
any desired manner, so long as a; is interior to the interval of 
convergence. 
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The following theorems merely restate Property (D) of Sec. 61, 

and Theorem 2, Sec. 66, in a form applicable to power series. 

« « 

Theorem 1. If 5) convergent power 

n-O n—0 

series defining^ respectively, the functions fi{x) and fi(x), then 

the series obtained by adding them term by term is the power series 
« 

2 ^ (ttn + bn)x'^ = (ao + bo) + (ai + bi)x 

n — O 

+ (Ct 2 + b2)x^ + • • • + (ttn + + • • • , 

which converges to fi(x) + f 2 (x) at least in the common interval of 
convergence of the two series. 

Example, 

:j-i— = 1 + X + I* + • • • 

1 — X 

and 

. x^ , x^ 

cos X = 1 - - • • • . 

Hence, 

Y~^ + cos X = 1 + 1 + X - |j + X* + + • • • , 

and the result is, certainly, valid so long as — 1 < x < 1. 
Theorem 2. The series obtained by multiplying the two con* 

00 OB 

vergent series ^ OnX^ and bnX'', defining, respectively, the func 

n-O n-0 

tionsfiix) and f 2 (x), and grouping the terms as for a finite product, 
is a power series 

djbo + (uohi + Oi5o)x + (0062 + Uihi + atbo)x^ -j. . . . 

+ (Oo6n + Ol&n-l + • • • + On6o)x’‘ + * * * , 

which converges to /i(x) •fiix), at least in the common interval of 
convergence of the two original series. 

Example, 

— = l+ x + x* + x»+---, 

1 — X 

- 1 I _1_ _l_ ** _L 

'-‘ + * + 2i+3I+ '' 
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and 

= 1 + 2* + |x* + I** + • • • , 

and the result is valid if \x\ < 1. 

The formulation of a theorem on division of power series 
is not so simple. Consider the reciprocal of the power series 



where s — — and v ^ 

Go ^ 

n — 1 

For all values of x for which the sum of the series 2) 

n —1 

numerically less than unity, so that \y\ < 1, 

(78-1) fix) ^ hi+ y + y*+ • • • + y* + • • • ) 

Go 

n—1 n—1 

« 

+ • • • + (x®-**)* + ' • * 1- 

n-1 

Therefore, the problem is reduced to one that involves mul¬ 
tiplication of power series. However, matters are not so simple 
here, because each term of the series (78-1) is itself an infinite 
series, and it is impossible to assert that the rearrangement 
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theorem (Sec. 66) established for the case of a single absolutely 
convergent series is still applicable. If the rearrangement is 
performed formally, there results a series in powers of x, say 

and the question arises as to what connection, if any, 

n-O 

exists between /(x) and the series so obtained. The reader will 
guess that the series (78-1) will converge for suflficiently small 

w 

values of y, so that the expansion 2) will converge to /(x) 

n —0 

for small enough values of x. This surmise finds a justification 

in the following general theorem, the proof of which is omitted:* 

•0 

Theorem 3. Given the power aeries f(y) = ^ bnjT y^here 

n-O 

«0 

y = 

ib«0 

then the power aeries 

«o «o ao 

will certainly converge for every value of x for which the sum of 

to 

the series ^ |aibX*| is less than the radius of convergence of the series 

ib-O 

m 

n—0 

An important observation may be made in connection with 
this theorem. If the series for/(y) in powers of x is to converge, 

to 

then the radius of convergence R of the series ^ must be 

n-O 

such that R > |ao|. If ao = 0, then f(y) surely can be expanded 
in a power series in x whenever R > 0. 

This observation may be clarified by considering an example 
in which ^e process of substitution of one infinite series into 
* See Knopp, E., Theory and Application of Infinite Series, p. 180. 
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another is legitimate, and another example in which it is not 
legitimate. 

Let it be required to obtain a series in powers of x for the func¬ 
tion * by substituting 

. , x^ 

= = + - 

into the power series for e*', namely, 

ev.l4.y + |.; + |!+.... 

The intervals of convergence of both of these series are infinite, 
so that 


c* = c*** = 1 + 


( \ 
V 3! 5! ■ ■ ' / 

+ “ 3! + 5! " ■ ■ ■ j 


+ 


c* 3x^ 8a;‘ 


4 1 I •»' 

= l+X + ^!--jy - 


5! 


This result is valid. 

As another illustration, let it be required to obtain a power 
series in x for the function log (1 + e*). 

Setting 

(78-2) j, = e.sl+a; + |! + |!+... 

and noting that 

(78-3) log (1 -H y) = y - I* -f- + • • • , 

^ves upon formal substitution of (78-2) in the right-hand member 
of (78-3), the series 

(7W) (i+.+£;+...)-i(i+.+^+...y 

■ ■ ■) — • 




POWER SERIES 


§79 


285 


Denote the sum of the series (78-2) for any particular value of 
a; > 0 by r; then (78-4) can be written as 

r — + * • • i 

which diverges since r is always greater than unity when a: > 0 . 
Accordingly, this method will not yield the expansion for 

f(z) = log (1 + e*) 

in a power series in x. 


It follows from Theorem 3 that if the series 2 / = anX^ con- 

n-O 

00 

verges for all values of x and the series ^ bny'^ converges for 

n-O 

all values of y, then the substitution of y in terms of x and the 

00 

rearrangement leading to the series ^ are legitimate. 

n-O 




Discuss the expansion of /(x) = — ^ - in powers of x by using 

1 "T 6* 


= 1 - 2/ + - j/» + • • • , 

1 -f- y 
and 

X* 

y = + _ + - + 

79. Calculations Involving Power Series. It was established 
in the preceding section that if the radius of convergence R 


of the series UnX** is greater than zero, then one can divide by 

n —0 

the power series, provided that Oo 5 ^ 0. Moreover, the resulting 
expansion will be valid for suflSciently small values of x. Thus 


(79-1) 


_ 1 _ 

ao -|- aix + 02** + • • ' + anX^ + ' 

+ CiX^ + ■ ■ 


- = Co + CiX 
-f CnX" + • • • . 


A practical scheme for determining the coefficients is outlined 
next. It follows from (79-1) that 
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1 = (a© + <llX + + * * * + ttn®" + * • * )(Co + C\X 

+ CjX* + • • • + +•••)> 

and an application of the uniqueness theorem on power series 
gives 

aoCo = 1, 

UoCl “1“ UiCo — 0, 

(Z 0 C 2 “1“ “f“ ^2^0 “ 0, 

floCa U1C2 “h o, 2 Ci “t" ciaCo = Oj 


The first of these equations determines Co, inasmuch as a© 0 
by hypothesis. A substitution of this value of c© in terms 
of a© in the second of these equations yields ci. Consequently, 
the coefficients Ci may be determined successively. 

As an example, consider the problem of calculating the recip¬ 


rocal of the series 



which has more than illustrative 


n*l 

significance. Denote the quotient 


1 


1 


+ - + - + 
^ 2 ! ^ 3 !^ 


+ 




by where c» s 


n—0 


Then 




+ • • 


+ (;r^!+ ■ ■ ■ + 

+ |f**+ • • • • • •) = !. 


and the equations for the determination of the Bn are 



0 , 



= 0 , 


f 
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nr® (n - 1 )! 1 ! (n - 2 )! 2 ! 1 ! (n - 1 )! " 


It is readily deduced from these equations that 

jBi = —K> Bj = B» = 0 , B 4 = "“Mo? 

Bs = 0, Bfl = ^2 j Bt = 0 , Bg = — Ho) ‘ • * 

These numbers (or their absolute values) are called Bernoulli*s 
numbersf and they play a prominent part in the theory of infinite 
series.* 

It may be remarked that 

_ 1 _ 

Hence, 


e* — 1 ~ n! 

n-O 


A similar procedure may be employed in calculating the 
quotient 


Uo “f" 0,\X -f" UjiC* -f- 

60 "b b\x + + 


+ anX’‘ + 


+ 6 nX- + 


—: = Co + cix + 

+ • • • + CnX^ + • 


where 60 5 ^ 0. Clearing of fractions and equating the coeffi¬ 
cients of like powers of x gives 


ao = bdCof 

Gi = bdCi + 61 C 0 , 

at = bffit + i>iCi 4* l>iCo, 


Gn = ioCn + biCn^i + ’ * ’ + bnCo, 


* See Knopf, K., Theory and Application of Infinite Series, p. 183. 
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from which the coefficients (with t = 0, 1, 2, • • • ) may be 
calculated successively. These coefficients are identical with 
those that would appear if one performed the division of the 
series by the ordinary rules for division of polynomials arranged 
in ascending powers of x. 


The calculation of the powers of an infinite series 
may be performed as follows. Let 


n ««0 


(ao + aia; + • • • + anX^ +*••)”' = co + CiX 

+ • • • + CnX^ + • • • . 

Then, 

m log (ao + aix + • • • + cLnX”^ +•••) = 

log (Co + CiX + * • • + CnX^ +•••)* 

Calculating the derivative and clearing of fractions, one finds, 

m(ai + 2a2X + • • • + -j- . . . )(co + CiX 

+ • • • + CnX^ +•••) = (^0 + dix + • • • + 

+ • • * )(ci + 2c2a: + • • • + +••')• 

Equating the coefficients of like powers of x on both sides of 
this equation gives a system of equations for the determination 
of Cl, C 2 , •••, Cn, ••• in terms of co. Clearly co = aj*, so 
that the coefficients d (where t = 1, 2, • • • ) can be determined 
successively. 


PROBLEMS 

1. Show by squaring the series that 


{l + x + x^ + 


2. If 


and 


+ + • • • )* 

= 1 + 2x + 3a;* + • 
1 

(1 - a;)*' 


1 -1-»-r 2, 3 , f 


sm X 


X* , X* 

* 3l‘^5I 


+ (n + !)«« 4 -. . . 


find the power series for e* sin z. 
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3 . Show formally that if/i(x) = and/2(a;) = where 


n —0 


n"»k 


M , 


bk ^ 0, then the quotient 7-7“ will be of the form 
/*W 


SdL 4. 


CL-i 

H-h Co + Ciar + C2X* -h 

X 


4 . Reversion of Series, If 

(1) y — yo = ai(x — Xo) + a 2 (x - Xo)* + * • • 

converges for |x — xo| < Ry and if ai 0, the series may be solved for 
X — Xo in terms of y — j/o to give 

( 2 ) X - Xo = 61(1/ - 2/0) + bt{y - t/o )2 + * • • . 


If ^ -?? ig replaced by 2, and x — Xo is set equal to x', the series ( 1 ) 

assumes the form 


(1') z = ojx' + ajx'* -f • • * + a'x'* + • • • , 

where a' = (n = 1, 2, • • • ), and (2) becomes 
Ol 

(2') X' = h\z + 6^2* . 4- ft'gn 4- . . . ^ 

where 

= 6na?. 

Substituting (2') in the right-hand member of (1') and equating the 
coefficients of like powers of 2, one obtains a set of equations for the 
determination of the coefficients 6'. 

Carry out the reversion of the series 


to obtain 


X = Bin- 


x» , X* 


’'^ 23 ^ 2 - 45 ^ 2 - 4-67 


5 v» 

n ' 


6. Use the procedure of Sec. 79 to calculate the first three terms of the 

series for —r—- to verify the expansion 
6 * + 1 


1 

e» + I 




- B„(2*« - 1) 


Xln-l 


(2n)t 


+ 



290 ADVANCED CALCULUS §79 

6 . Find the first three terms of the series for sec x obtained by 
calculating 

1 ^_ 1 _ 

cos X ^ «• . 05* 

+ - 

7. Obtain the expansion for 

X _ _ X _ 

sin 05 X* . 

*"5i + «i- 


C* C* S'** 

8 . Find the series for sinh x ■- - — and cosh x ■- - — 

A 2 

with the aid of = 1 4- « + |j + |“j + • * • . 


9. Find the expansion for tanh x 


€• — e"* 
€• + «"• 


with the aid of 


X* X* 

e.,i + , + -, + 5-,+ 


10. Assuming 


/(*) = 1*1 
n — O 

show by successive differentiations of /(x) that the coefficients a» are 
of the form 


so that 


On 


_ /<->( 0 ) 
n! ' 






This is the Maclaurin series. 



CHAPTER IX 

APPLICATIONS OF POWER SERIES 


80. Extended Law of the Mean. It was shown in Sec. 20 that 
a function /(x) that is continuous in the closed interval {a, x) 
and possesses a derivative at every interior point of the interval 
can be written in the form 


/(*) =/(a) + (*-a)m 

where { is some interior x>oint of the interval (a, x). This 
result, known as the law of the mean^ can be extended if the func¬ 
tion /(x) together with its first n — 1 derivatives is continuous 
in the closed interval (a, 6), and if its nth derivative exists at 
every interior point of (o, 6). 

In order to obtain the extended law of the mean define the 
function jF(x) by the equation 


^’(®) - m - fix) - (6 - x)/'(x) - 


- 


- (6 - a)ria) - 


(6 - a)\ 


21 


which is so constructed that 


F(o) = F(5) = 0. 

The derivative of Fix) is readily found to be 
(b - »)*-»- 


(80-1) F'ix) = 


r/<»>(*) 


(n - 1)1 

f - m -Q >-«)/'(“)- 


291 





292 


ADVANCED CALCULUS 


8«0 


Since the function F{x) satisfies the conditions of RoUe’s theorem, 
F\x) must vanish for some value of x, say * = {, interior to the 
interval (a, h). 

Setting a: = f m (80-1) gives 


(80-2) m = /(o) -f- (6 - 

+ 


a)/'(a) -!-••• 


(&-q) 

n\ 




where a < f < 6. Now, if 6 in (80-2) is set equal to x, one 
obtains the formula which expresses the function f{x) as a 
polynomial of degree n in « — a, namely, 


(80-3) fix) = /(a) + (X - a)r(a) 

(x — a)"”*^ 


+ 


(n-l)I 




(x — o)” 


n! 




where a <(< x. The coefficients of the powers of x — a in 
(80-3), except the last one, are constants. The coefficient of 
(x — a)’* is a function of J, which in turn depends upon the 
magnitude of x. It may happen that this last term in the 
formula (80-3) is negligibly small in comparison with the preced¬ 
ing ones, and in such a case the function f(x) can be approxi¬ 
mately represented by a polynomial of degree n — 1 in x — a 
with constant coefficients. 

The formula (80-3) is known as Taylor's formula, and its 
last term, 

(80-4) Bn = (5-^/(»)({), 


is called the Lagrangian form of the remainder after n terms. 

The foregoing derivation of the Taylor formula is not devoid 
of some artificiality, and the reader may have a feeling that the 
definition of the function F{x) anticipates the result. The 
following section is devoted to a discussion of two simpler 
methods of deriving formula (80-3), but the gain in simplicity 
there is achieved by imposing restrictions on the function f{x), 
which are more severe than those required by the proof given 
above. It should be noted that the proof just given requires 
neither the continuity of the nth derivative in (a, h) nor its 
existence at the end points of the interval. 
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81. Taylor’s Formula. If the function/(*) is assumed to have 
a continuous nth derivative throughout the closed interval 
(o, b), it is possible to give a simple derivation of Taylor’s formula 
by integrating the nth derivative of the function n times in 
succession. Thus, if x is any point of the interval (a, 6), then 


f dx = f»-«(x)r = 

Ja \a 

I r = j dx — \ /'•‘“’Ha) dx 

= _/(»-«(o)“_ (a; _ a)/(--«(a), 

m 7(’‘>(x) (dx)» =- (x- a)/(»-«(o) 

I 

_ ~ 




j: - j: 


y(»>(x) (dx)“ = /(x) - f(a) - (x - o)/'(o) 

-^rw- 

Solving for /(x) gives 

(81-1) f(x) = /(a) -)-(*- airio) -H 




where 


(81-2) “X* ‘ 

It is easy to transform the integral form (81-2) of the remainder 
to the Lagrangian form (80-4) with the aid of the first mean-value 
theorem for integrals.* In fact, 

jr7<’‘>(a!) dx = (x — a)/^’*Kl)> where a ^ ^ x. 

Integrating both imembers of this equation n — 1 times, between 
the limits a and x,' gives 


* See See. 87. 




294 


ADVANCED CALCULUS 


J81 


which is the Lagrangian form (80-4) of the remainder. 

Another proof of Taylor’s formula, which leads to an extremely 
useful form of the remainder i2», depends on the integration by 
parts of the obvious identity 

(81-3) /(a + h)- f(a) = JJV(o + h - t) dt, 

where the prime over f denotes the derivative of the function 
with respect to its argument a + h — t. 

Integrating (81-3) by parts successively gives 


f(a + h) -f(a) 


-£ 


f'(a + h-t)dt 
|A 

= tf(a + h-t) 


^ if'io “l- A — t) dt 


= hf'ia) + ^tT(a + h-t) 


+ 


£liT'(a + h-t)dt 


hfia) -h ^fia) + - ■ + ^J^j/(»-«(a) 


+ 


Setting h = X — a, one obtains 

/(*) “ /(a) + (* - a)/'(a) -1- <5-^/'’(o) + - - 




where 


If the variable of integration in (81-4) be changed to X, which 
is defined by the relation X — a; — f, then (81-4) becomes 
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(81-5) Rn = - X)-‘ dX. 

In order to obtain the Lagrangian form of the remainder from 
(81-5), it is only necessary to apply the first mean-value theorem 
for integrals.* Since a ^ \ x, (x — X)""* does not change 
sign in the interval of integration, and formula (37-3) gives 


Rn 


_ f 

(n - l)!jo 


(x - X)»-» dX = 


(x - a) 
n\ 




where a ^ ^ x. This establishes the identity of (81-5) with 
the Lagrangian form (80-4). 

A special form of Taylor’s formula, which results from setting 
a = 0 in (80-3), is known as the Maclaurin formula. It is 


(81-6) fix) = m + xf'iO) + |5/"(0) + • • • 
where 


Rn 


/<">({) 

ni 


0 < f < X, 


or 

The Lagrangian form of the remainder is frequently written 
in a slightly different form. Setting x — a = h and recalling 
that a < i < X, one can write 

+eh, 

where $ is some number lying between 0 and 1. The number 
B, of course, depends upon the value of x. Consequently, 
the formula (80-3) can be written as follows: 

/(. + ») - /(a) + r(a)h + + • • ■ + 

where 0 < < 1. 

* See Sec. 37. 
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82. Taylor’s Series, 
formula, 


It was shown in Sec. 80 that Taylor’s 


(82-1) /(*) = /(o) - o) -f 


+ /"-"W fa _ 


permits one to express a suitably restricted function f(x) as a 
polynomial of degree n in a: — a. The first n coefficients of 
the powers of x — a in (82-1) are constants, whereas the coefli- 
cient of (x — a)* is a function of x, inasmuch as the magnitude 
of { depends upon the choice of x. 

It may happen that/(x) is of such a nature that the remainder 

jRn = -—— o)"" is bounded for all values of x in the interval 
nl 

(a, b)j so that 


|Kn(x)| = 


n! 


(x — o)* 


^ M„, 


where is a bound which in general depends on both x and n. 
If the function f(x) has derivatives of all orders in the interval 
(o, b), and if tends to zero uniformly as to {in (o, x) as n «, 
then the formula (82-1) can be written as the infinite series 


(82-2) /(x) = /(a) -|-/'(a)(x — o) + 


ria) 

2! 
/(»)(a) 


+ 


n 


(x - a)* -f • • 
(x — o)“ -f 


which is known as Taylor’s series. A special case of Taylor’s 
series (82-2), obtained by setting a = 0, is known as Maclaurin’s 
series. It is 

(82-3) fix) =/(0) +ri0)x + • • • 

^ nl ® ^ 


The demand that Rnix) tend to zero uniformly with the 
increase of n is sufficient to deduce the infinite series represents- 
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tion (82-2) of the function f(x). Stated in precise form this 
requirement means that for each x in (a, b) and any e > 0, one 
can find a positive integer Nj independent of the choice of { in 
(a, x), such that \Rn{x)\ < € for all n ^ iV. 

It may happen that a formal application of the formula (82-2) 
will yield a series which does not represent the function with 
the aid of which the series is generated. An example, due to 
Cauchy, may help to clarify this assertion. Let it be required to 
expand the function 


m =« 

= 0 , 


if 

if 


X 0, 

X = 0, 


in Maclaurin's series. Calculating the derivatives of f(x) gives 

/'(x) = 

, 4 - 6x* -1 


/‘"’(a:) = »•, 

where P(x) is a polynomial in x, and p > 1. 

If the value of f^^^ (x) at x = 0 is calculated,* it is found that 

/'(O) =/"(0) = • • • =/(-)(0) = . . • = 0. 

Therefore, the formula (82-3) gives 

0 + 0 • X + ^jX* + • • •+ ^x" + • • • , 


which converges to zero for all values of x, and hence fails to 

_1 

represent the function e **. Moreover, if <p{x) is any function 
that can be represented by Maclaurin's series as 


<p{x) = <p(0) + /(0)x + + 


+ ■ 


o(») 


( 0 ) 


n! 


x" + 


See Sec. 14. 
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F{z) = ip{x) + e ** 

will have a Maclaurin expansion that is identical with that for 

_1 

ip{x). The reason why the function /(a?) = 6 ** cannot be 
represented by a Maclaurin’s series is that the remainder, 

= (0<f<x), 

does not converge to zero for each x in any interval including 
the point a; = 0. Of course, Taylor's formula (82-1) can be 

applied to give a representation of e and in this case the 
expansion about the origin reduces to a single term, which is 
precisely the remainder Un¬ 
it follows from the uniqueness theorem on power series* 
that if any function can be represented by a power series, then 
the coefficients in the power series must be identical with those 
appearing in the Taylor's series representation of that function. 
83. Applications of Taylor’s Formula. 

(a) The Expansion of Sin x. Let it be required to expand the 
function/(x) = sin x in Maclaurin's series. Now, 


/(*) = sin X, 

m = 0; 

/'(x) = cos X, 

m = 1; 

f'(x) — —sinx, 

r( 0 ) = 0; 

/"'(x) = —cos X, 

r'(0) = -1; 

/<»>(x) = sin (x + ^)» 

/(»>(0) = sin 


A substitution in the Maclaurin formula (81-6) gives 

+ ' +Si““M + T;’ 


and, since 
it follows that 


0 < { < *, 


•SeeSM.77. 


{ = te, 
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where 0 is some positive number less than unity. Thus the 
remainder Rn is 

(83-1) Rn = ^^ sin (^$x + 

But the numerical value of sin x never exceeds unity, so that 


for all values of x. Now if 2; is confined to lie in the interval 
(—r, r), where r is an arbitrarily large positive number, then 


lim 


n! 


= 0 


for all values of x such that |x| ^ r. Consequently, Rn(x) 
converges to zero uniformly in any finite interval (—r, r), and 
one is justified in writing 


sin X 





i(>2fi—1 


(2n - 1)! 


+ 


In order to illustrate the use of the remainder in estimating 
the magnitude of the error made in calculating the value of 
sin X with the aid of the infinite series, let it be required to 

compute the numerical value of sin 10®. Since 10° = ^ radian, 

formula (83-1) gives 



In particular, if n = 9, the polynomial 


(* 


— 

31 51 7!^.- 


T 

18 



gives the value of sin 


T 

18 


with an error that is less than 
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(6) The Expansion of e*. A procedure entirely analogous to 
that employed in the preceding example gives for c* an expansion 




+ 


j(» f> 

(n — 1)1 nf 


$x 


0 <6 < 1 , 


A little reflection shows that for all values of x such that \x\ r, 
where r is any positive number, 


lim = 0. 

n-- n! 

Consequently, one can write 


(83-2) e-.!+*+!,+ ... +£,+ 


For X = 1 this formula gives 


* = ^ + n + A + 


+ ^ + 


If the sum of the first n terms is taken as an approximate value 
of e, the error is less than 

^!(^ + i ;r! 

n 

since each term of this series is not less than the corresponding 
term of the series 


J-f_I__ 4- • • • 

n! ^ (n + 1)1 ^ (n 4- 2)1 ^ 

Thus for n.= 10, the error is less than 

w.ri ^o 

and the value of e is easily found to be 2.718282 correct to six 
decimal places. 

If it is desired to obtain values of e* when 1 < » < 2, then 
the power series in i — 1 is more useful than (83-2). The 
mcpansion of f(x) in powers of a; — 1 is 
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fix) =/(l) +/'(!)(* - 1) +^-^ix -!)*+••• 

+ ^^(*-1)“, (!<{<*), 

and, since 

/(»)(*) = e*, /<»)(!) = e, (n = 0, 1, 2, • • • ), 

(83-3) c* = e[l -f- (a: - 1) + l(a5 - 1)* -f- • • • 

The remainder in this case is 

= ^,(x - D- 

so that the error made in using only four terms of the expansion 
(83-3) is 

R, = ^(x - 1)«, (1 < { < x). 


If X = 1.1, then 


= e 


2! ^ 3! 


•1)*1 -I- 

+ 4!^®- 


1 )‘ 


i into . 0.0001 ^ 

= 1.1052e H- ^ 

24 


Since 1 < f < 1.1, and since is an increasing function, 
is certainly less than so that R 4 is certainly less than 


0.0001 , 


< 0.00003. 


(c) The Binomial Theorem. The fact that the binomial series 

(83-4) 1 + m* + —+ • ■ * 

. w(to - 1) • • • (m - n -I- 1) ^. + . . . 
n! 


converged for all values of x such that |x| < 1 is readily established 
with the aid of the ratio test, but it is not so easy to prove that 
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the series (83-4) actually converges to the value of (1 + x)*" 
when m is not a positive integer. 

This section concludes with the discussion of the convergence 
of the expansion for the function 


/(x) = (1 + x)^. 

The derivatives of fix) are found to be 

/'(x) = m(l + x)’"“S 
/"(x) = m(m — 1)(1 + x)*”"^ 

f^^^ix) = m(m — 1) • • • (m — n + 1)(1 + 


Substituting the values of these derivatives, calculated at x == 0, 
in Maclaurin^s formula (81-6) provides the expansion 


(1 -h a;)"* = 1 -f mx + - —- x^ + • * • 

, m(m - 1) • • • (m - n + 2)__ 

(n-l)! ^ 


+ Rnj 


where Rn can be expressed either in the Lagrangian form (80-4) 
or in the form of the integral (81-6). 

It is more convenient to discuss the behavior of Rn by express¬ 
ing it in the form (81-5), so that 

(8W) B.. 

It follows from the first mean-value theorem for integrals 
(Sec. 37) that 

(83-6) ^*(1 -I- X)»-"(a: - X)--^ dX = (1-f {)"-«(* - {)“-ijr*dX 

= (1 + {)"-"(x - {)»-‘x, 


where 0 ^ *. 

The substitution of ( = ffx, where 0 :£ 9 1, permits one to 

express (83-6) in a more convenient form, namely, 


J[*(1 -I- X)"-»(x - X)»-* dX * (1 + to)’"-»(l - e)»-»x" 

“(rr^) (1+ 
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Hence, (83-6) can be written in the following way: 

(83-7) 

If X is confined to the range — 1 < x < 1, then the first bracket 
in (83-7) tends to zero as n becomes infinite. * The second 
bracket, obviously, does not exceed unity if |x| < 1, and the 
last bracket is independent of n. Accordingly, 

lim Rn — 0 

n—►« 

for all values of x in the closed interval ( —r, r), where r is any 
positive number less than unity. Consequently, it is permissible 
to write 

(1 + x)”^ = 1 + mx + + • • • 

+ - 1) ••• (m- n + 1 ) ^^ + . . . . 

n! 


The ratio test shows that this series diverges if the numerical 
value of X is greater than 1, so that the series does not represent 
the function (1 + x)”* for |x| > 1 unless m is a positive integer. 
If X = ±1, the ratio test fails, and one must resort to more 
delicate tests to establish the behavior of the series in this doubt¬ 
ful case. 

It follows directly from Hummer’s test (Sec. 63), upon setting 
00 

On = n, thatf the series 

n —1 

(<*) converges absolutely if lim n| 

n—> <0 


Un 

IWn+l 


-0 


> 1 , 


*For, consider the sequence {an) whose general term an is equal to 




Then lim 




lim 


|x|, and 


(n-1)! 

it follows from the ratio test that the sequence (an) is a null sequence if 
1*1 < 1 . ' 

t This is known as Raah^*9 See also Prob. 6, Sec. 63f 
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>) l«»l diverges if lim nf — 1^ < 1. 

»»-► 00 \JWn+l| / 

n-1 

The general term Un of the binomial series is 


_ m(m — 1) 


so that 


• • (w - n + 1) 
n! ® ' 


n + 1 1 
m — nx 


Consider first the case when x = — 1. Then 

Un n + 1 


so that 


lim n (= 1 + m. 
\n — m ) 


It follows from (a) and (6) that the series 
converges if m > 0, 

and 

diverges if m < 0. 

If X = 1, the series (83-4) becomes alternating if n > m + 1, 
so that the absolute value of the ratio of the nth term to the 
n "4" 1 • • 

(n l)st is still - ^ The foregoing discussion shows that 

in this case the series converges absolutely so long as m > 0. 
If m < 0, the series of absolute values diverges, but the alter¬ 
nating series may converge conditionally. From the structure 
of the general term 

m{m — 1) • • • (m — n + 1) 
-^ 

it is clear that if m ^ — 1, the successive terms do not decrease, 
so that the series diverges in this case. 

If m is between 0 and —1, one may write the absolute value 
of tin in the following form: 
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where a — 1 m. It will be shown next that lim lu„| = 0, 
SO that the series is convergent (since it is obvious that 

|«n+l| < 1U,|). 

Now 

n 

(83-8) log \Un\ = 2 log 

and, since 1 — ^ is less than unity, each term of the series 

(83-8) is negative. It is easy to show, with the aid of the integral 
test of Cauchy, that (83-8) diverges if n oo. Therefore, 

lim log \un\ = — 00. 

n-* « 

But if log \un\ becomes negatively infinite as n oo, then \un\ 
itself must tend to zero. 

The results just obtained can be summarized as follows: 
The series (83-4) is convergent if \x\ < 1 and divergent if |x| > 1. 
If X = 1, convergence is absolute, if m > 0. 

If X = 1, convergence is conditional, if — 1 < m < 0. 

If X = 1, the series is divergent, when m ^ — 1. 

If X = —1, convergence is absolute if m > 0. 

If X = —1, the series is divergent when w < 0. 

It follows immediately from AbeFs theorem on the continuity 
of power series (Sec. 76) that if the binomial series converges 
for X = 1, then its sum is precisely equal to 2"*. If x = — 1 and 
m > 0, then the sum of the series (83-4) is necessarily zero. 

PROBLEMS 

1. Verify the following expansions: 

(а) |(e. + e-.)-l + | + f; + |-; + ---; 

/t.\ 1/ X . ** I 1 L 

(б) 2(e*-«-)-* + 3j + 5, + ^, + ---; 

X* X* X* 

+ + -; 

(d) log* - (*-!)- H(x - 1)* + «(»-!)*-; 
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<«"»**- V+KV)’+!(V)'+ 


[Hint: Set a? = ~ in 1(d)]; 
z 


17 


62 


(/) taii»-» + 3 + + + + 

f \ 1 I I I I 

(») “°* = i + 2!'‘’ir + 'r+ ' ■ ■ ’ 

_. lx* , IZx* , 1 • 3 • 5 . 

!r + 23+2-45‘*’2-4-67''' 


(i) tan“^ 


x* . «» x'f , 
*"3+6 " 7 + 


(j) log (* + •v/1 -4-1?) = X — — ——I- -—— —— 

23 2*45 2*4*67 

. . , , Sx® 3x« , 

(*)‘^'“i+®+^“4r“'5r"6r+"‘’ 


13 5XJ 

*T • 


(0 


^ 21 3! 41 ^ 


2. Expand: 

x* 

(а) tan a; in powers of a? — 

(б) e* in powers of a; — 2; 

(c) sin a; in powers of x — 

o 

(d) 2 + X* — 3x® + 7x« in powers of x — 1; 

(e) log X in powers of x — 2. 


84. Euler’s Formulas and Hyperbolic Functions. Two par¬ 
ticular linear combinations of exponential functions are of such 
frequent occurrence in mathematics that it has been found 
convenient to give them a special name. Tbe expression 
)^(6* + c~*) is called the hyperbolic cosine of x, and is denoted by 

cosh X SE J^(e* + «”*). 

The derivative of cosh x is equal to — 6“*) and is called the 
hyperbolic sine of x. Thus, 

sinh X s — c“»). 

These functions are named hyperbolic because they bear 
relations to the rectangular h 3 rperbola x* — y* ^ that are 
very similar to those borne by the circular functions to the circle 
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X* + y* = a*. The formal analogy between the circular and the 
hyperbolic functions is best exhibited by the table given later 
in this section. It will be recalled that the expansion in Mac- 
laurin’s series for c“ is 

(84-1) ’ ‘ ' ' 

so that 

(84-2) e‘ = l + x + j^ + ^^ + - ’ 

and 

(84-3) = x + 

Subtracting (84-3) from (84-2) gives 

c*-e-* = 2(x + |?, + |^+ • . 

80 that 

fiX —X /y3 /wB 

(84-4) sinh x = - ^ -~ ® 3 I ll • 

On the other hand, addition of (84-2) and (84-3) gives 

fiX _ 4 — / 1(»4 

(84-5) cosh X =- 2 -”^"^^."^41"^ ' * * * 

Moreover, if it is assumed that (84-1) holds for complex numbers 
as well as for real numbers, then 

(84-6) c** = 1 + i* -I- -h -h • • • 

and 

(84-7) + + 


where i ^ \/—1. Adding (84-6) and (84-7) and simplifying 
shows that 


e** -f- e-** 



4 . _ £? 4 . 

2 ! ■^ 4 ! 6 ! 



f 


which is Cognized to be the series for cos x multiplied by 2. 
Thus, 
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(84-8) 


cos X =- 2 - 


It is readily verified that subtraction of (84-7) from (84-6) leads 
to the formula 


(84-9) 


sin a; = 



By combining (84-8) with (84-9) there result two interesting 
relations, 

cos X + i sin X = and cos ar — z sin x = c”**, 

which are known as the Euler formulas. 

The following table exhibits the formal analogy that exists 
between the circular and hyperbolic functions; the relations 
that are given for hyperbolic functions can be established readily 
from the definitions for the hyperbolic sine and the hyperbolic 
cosine: 


Circular Functions 


sin X — 


+ «“*■*) 


tanx 


»(«** + e“**) 


cotx 


sin X = X -1— — • • • 

31 61 

cos T=1-r — “• * • 

2! 4! 

sin* X + cos* X = 1 
1 4- tan* X » sec* x 
sin 2x » 2 sin X cos x 
cos 2x = cos* X — sin* x 
sin (x ± y) = sin X cos y ± 

cos X sin y 

sin X 

—;— *■ cos X 
ax 

d COB X 

—;— » —smx 
dx 

d tanx 

—;— * sec* z 
dx 


Hyperbolic Functions 


sinh X = ~(c* — «■"*) 

cosh X = H (c* + «”*) 

c» ~ e-» 

tanhx *- 

e* -h 


COth X * -;- 

tanh X 

X* X* 

einh x = x +—+— 4-• • • 

OI 01 

X* X* 

cosh• • 

Zl 4! 

cosh* X — sinh* x = 1 
1 — tanh* X = sech* x 
sinh 2x » 2 sinh x cosh x 
cosh 2x = cosh* x -f sinh* x 
sinh (x ± y) — sinh x cosh y 

± cosh X sinh y 

d sinh X 

—;- = coshx 

ox 

d cosh X . , 

-;- = sinh X 

dx 

dtanhx 

—1 - » sech* X 

dx 
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86. Integration of Power Series. It was shown in Sec. 76 that 
a power series converges uniformly for all values of x in any 
closed interval that is interior to the interval of convergence. 
Moreover, the series resulting from term-by-term differentiation 
and integration of a power series have the same intervals of con¬ 
vergence as the original series and will converge to the derivative 
and integral of the function represented by the given series so 
long as a: is interior to the interval of convergence. These 
facts are of great use in obtaining the power-series expansions 
of functions defined by integrals. 

Thus, consider the integral 


X 


dz 


ol+z^ 


tan”^ X. 


Expanding the integrand in a power series in 2 , one obtains 

tan“^ X = ^*(1 — 2^ + 2^ — 2® + * • * ) dz 



Inasmuch as the power series in the integrand is convergent for 
\z\ < 1, one is assured that the expansion for tan“^ x is con¬ 
vergent for \x\ < 1. The reader will convince himself that the 
procedure employed here in deriving the power series for tan~^ x 
is much simpler than that of calculating the successive derivatives 
of tan“^ X and applying the Maclaurin formula. The uniqueness 
theorem guarantees that the expansion obtained above for 
tan“^ X is precisely the Maclaurin expansion. 

Obviously, the series converges at the end points a; = ±1 
of the interval. Since the series converges for x = 1, it follows 
from AbeFs theorem (Sec. 76) that the series actually converges 

to the value tan“^ ^ “ i arrives at the conclusion 

that 



Consider another example, namely, 

r* dz 

log (1 + *) = 1 + a 
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log (1 + x) 




2 + 2 ' 


2 _ 


)dz 


X* , X* 

= ® ^ +-3 - 


This expansion is valid for |a;| < 1. For x = ~1, the series 
is divergent. For x = 1, it converges, and it follows from Abel's 
theorem that its sum is log 2. 


PROBLEMS 

1. Show that the remainder in the expansion of log (1 + 2 ;) is 


Rn{x) = ( 


2. Obtain the expansion 


^^"Jo 1 + 2 


(— 


+ 2 (n+l)(l + te) 


sin-‘ ® = J*' 


dz 


lx® ,1 -Sx® 

= T -4--1- 

^ 23 ^ 2 - 45 ^ 


and show that 


2 232*45 

3. Show that the remainder in the expansion of tan'^ x in a power 
series in x is 


Rn{x) 




+ Z‘ 


dz 


(_l)n^2n+l 

(2n + 1)(1 + 


and show that En(l) -♦ 0 when n — ► 

86. Evaluation of Definite Integrals. One of the important 
uses of infinite series is in the evaluation of some difficult integrals 
for which the indefinite integral cannot be found in closed form. 
Three interesting examples of this use of infinite series are given 
below. 

_g—» 

The . integral I - - — dx cannot be evaluated with the 

aid of the fundamental theorem since the indefinite integral 
cannot be obtiuned in closed form. The expansion for —-—> 
if obtained directly, would lead to an extremely complicated 
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expression for each derivative. The expansion is most easily 
obtained by using the separate expansions for c* and e~*. Thus, 

e» = l+a. + |-; + ^;+---, 

^ ^2! 31^ ’ 


and 

Hence 




In order to evaluate the integral dx, recall that 


1145. 


e» = l + « + |^ + |^+..-, 


so that 


Then 


. 1 I • I sin* X , sin* x , 

e-“» = 1 + sin X + + 


2! 


3! 


jV.j,. 


- . . , sin^ X , sin’ x , 

1 + sin X + —: 5 nr + -th- + 


2! 


3! 


) 


dx 


o I I 1 j • I sin® X , sin’ x , 
= 2 I 11 + sin X + -KT + + 


3! 


• ^dx, 

which can be evaluated with the aid of the Wallis formula, 

T » 

fam-**. fa - -, 

Jo Jo n{n — 2) • • • 1 or 2 ’ 


where a = 1, if n is odd; and a = if n is even. 

Let it be required to evaluate the integral* 

* The integrand in this integral becomes discontinuous at x >• 1, but it is 
easy to establish the convergence of the integral (see Sec. 95). 
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K 




dx 


-t where fc* < 1. 


\/(l - x^){l - k^x^) 

A substitution of x = sin 6 reduces the integral to 


K = 


=/: 


de 


"s/l — A:* sin* 0 


But 


(1 - Jfc* sin* = 1 + 5 ** sin* 0 + sin* 8 + • • • . 


Consequently, 

T 

2i: = I + i**J^%in* 0 + 


+ l-3.-;-(2\-V f sin*n.dg 


2-4 
3 


= |‘ + ©‘’+■•■+(- 


2 n 
(2n - 1) 


2-4 


2n 




+ 


Since 


/: 


sin^"' 6 do = 


1 *3 • • • (2n - l)7r 
2 • 4 • • • 2n 2' 


If k is near unity the convergence of the resulting series is not 
so rapid as may be desired. In such a case a substitution of 
= I — k^ can be made, so that 


(1 - jfc* sin* e)-^ = -^(1 + Z* tan* «)-«. 

COS 0^ 

Expanding the right-hand member of this expression by the 
binomial theorem and integrating term by term gives a series 
that converges rapidly for small values of Z. 

PROBLEMS 

1. Calculate cos 10^, and estimate the maximum error committed by 
neglecting terms after 
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2. Find the interval of convergence of the expansion of e» in power 
series in x. Determine the number of terms necessary to compute 
accurate to four decimal places from this expansion. 

5. Compute sin 33®, correct to four decimal places. 

4 . Develop the power series for tan”^ x in powers of x, and find the 
interval of convergence. 

r* dx . 

6. Expand the integrand of J ^ ^ ^ • in power series in x, and inte¬ 
grate term by term. Compare the results with that of the preceding 
problem. 

6. Compute = 2(1 + ^ 2)^7 correct to five decimal places. 

7. Develop the power series in x for sin”^ x and hence establish that 


T 

6 


1 + 1._ 

2 2 3 


2 




1-3 1/1 


2-4 5V2 


+ 


8. Differentiate term by term the power series in x for sin x and thus 
obtain the power series in x for cos x. What is the interval of conver¬ 
gence of the resulting series? 

9. Divide the series 


sin X = X — 


?! j- ?! 


by the series 


1 X* z* 
008X^1--, + -,- 


> 


and thus obtain the series for tan x. 

10 . Differentiate the series for sin“^ x to obtain the expansion in powers 
of X for (1 — x*)~^. Find the interval of convergence. Is convergence 
absolute? Investigate the behavior of the series at the end points of the 
interval of convergence. 

11 . The integrals 


dd 

FQc, <p) = Vl - sin*» 
and 

E(kf ip) = j'jy/l ^ 

where 4: 1, are caUed the elliptic integrals of the first and second kinds, 
respectively. Discuss the evaluation of these integrals. The numbers 
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{t, l) ud s(*, l) 


are called the complete eUiptic integrals and are 
The values of the func- 


denoted by the letters K and E, respectively, 
tions F(kf ip) and Eijc, ^) are tabulated.* 

12. The major and minor axes of an elliptical arch are 200 ft. and 
50 ft., respectively. Find the length of the arch. Compute the length 
of the arch between the points where x ~ 0 and x = 25. Make an 
estimate of the remainder. 

13. Show that 



-\/l — J^sin*v> 


Hint: Set \/cos x = cos 

14. Show that 


p = ^(K - E). 

Jo \/l — A;* sin* B 


Hird: sin* ^ ^ ^(1 ” sin* 3). 

16. Show that 


K 


■X 




0 \/l — A:* sin’ 9 


IT 

2 


if A;* < 1. 

16. Find the length of one arch of the sine curve. 

17. Find the length of the portion of y = sin x l 3 dng between x = 1 
and X = 2. 

18. Show that the length of arc of an ellipse of semiaxes a and b is 
given by 


» 

~ 4aJ ^^\/1 — €* sin* 0 dJB 

- ) 


, where e is the eccentricity. 


* See, for example, Peirce’s A Short Table of Integrab. 
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Estimate the magnitude of the remainder after three terms. 


19. Evaluate in series: 



<.)j 

r sin (x*) dx; 

'o 

(&) 

r ^ sin X dx 

Jo Vl - »*’ 

(.)j 

fo X 

(d) 

R 

i 

r* 



wj 

cos (x*) dx; 

'0 

(/) 

I (2 — cos x)”^ dx 



s= 




= 

I)”''*'' 

(,)J 

r* cosxdx 
lo Vi ’ 

(h) 

1 * dx. 

Jo 


20. Show, by squaring and adding the ‘power series for sin x and 
cos Xf that 

sin* X + cos* X — 1, 



STJ Maxima and Minima of Functions of One Variable. A 

function/(x) is said to have a maximum at x = a, if 


A+s/(a + h) -f{a) <0, 
and 

A-s/Ca-A)-/(a)<0, 

for all sufficiently small positive values of h. If A+ and A“ are 
both positive for all small positive values of A, then f(x) is said 
to have a minimum at x » a. 
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It is shown in the elementary calculus that if the function 
f(x) has a derivative at x = a, then the necessary condition for a 
maximum or a minimum is the vanishing of /'(x) at the point 
X = a. Of course, the function f(x) may attain a maximum 
or a minimum at x = a without having /'(a) = 0, but this can 
occur only if /'(x) ceases to exist at the critical point (see Fig. 
73). 

Let it be supposed that /(x) has a continuous derivative of 
order n in some interval about the point x = a. Then it follows 
from Taylor^s formula that 


A+=/(a + A) - /(a) 

where 0 < < 1, and 

A-s/(a-A) - /(a) 


^ in - 1)! ^ ’ 


n! 


(n-l)r 


where 0 < ^2 < 1. Let it be assumed further that the first 
n — 1 derivatives of /(x) vanish at x = a, but that is not 

zero. Then 


and 


n! 


A- . (-D- Z-faj W k 


Since f^^^(x) is assumed to be continuous in some interval 
about the point x = a, + 6ih) and — d 2 h) will 

have the same sign for sufficiently small values of h.* Con¬ 
sequently, the signs of A+ and A” will be opposite unless n is 
an even number. But if /(x) is to have a maximum or a minimum 
at X = a, then A"^ and A~ must be of the same sign. Accordingly, 
the necessary condition for a maximum or a minimum of /(x) 


* See Theorem 3, Sec. 12. 
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at o; = a is that the first nonvanishing derivative of /(x), at 
X = a, be of even order. Moreover, since both A+ and A" 
are negative if fix) is a maximum, it follows that(a) must be 
negative. A similar argument shows that, if f{x) has a minimum 
at X = a, then the first nonvanishing derivative of fix) at x = a 
must be of even order and positive. 

If the first nonvanishing derivative of fix) at x = a is of odd 
order, and /"(<^) = 0, then the point x = a is called a point of 
inflection, 

y Example. Investigate fix) = x® — 5x^ for maxima and 
minima. Now 


/'(x) = 5x^ - 20x», 

which is zero when x = 0 and x = 4. Then 

/"(x) = 20x3 - 60x3, f'(0) = 0, /"(4) = 320; 

/'"(x) = 60x3 _ i20x, /"(O) = 0; 

f^ix) = 120x - 120, /^(O) = -120. 

Since/"(4) > 0,/(4) = — 256 is a minimum; and since/^'^(O) < 0, 
/(O) = 0 is a maximum. 

PROBLEMS 

1. Examine for maxima and minima: 

(а) y = x^ — 4x3 -f 1; 

(б) y = x3(x - 5)*; 

(c) 2/ = X + cos X. 

2. Find the minimum of the function y = x*, where x > 0. 

Hint: Consider the minimum of log y. Ans. x = — 

e 

3. Show that x = 0 gives the minimum value of the function 

2 / = 6* -h e”* + 2 cos x. 

88. Taylor’s Formula for Functions of Several Variables. 

Let /(x, y) be a function of two variables x and y that is con¬ 
tinuous in the neighborhood of the point (a, 5), and that has 
continuous partial derivatives, up to and including those of order 
n, in the vicinity of this point. 

If a new independent variable t is introduced with the aid of 
the relations 


(88-1) 


X = a + orf, y ^ b + pti 
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where a and jS are constants, there will result a function of the 
single variable t, namely, 

(88-2) F(0 SB /(x, y) = /(o + af, 6 + &t). 

Expanding F{t) with the aid of the Maclaurin formula gives 
(88-3) F(f) = F(0) -f- F'(0)< -|- + • • ■ + 

where 0 < 8 < 1. 

It follows from (88-1) and (88-2) that* 


?'«)=/.(*,») I+/.(»,») I 

= /»(*, y)« + /»(*, y)/J- 

Calculating F"(<) and F'"(0 from this expression gives 


F"{t) = [/«(®, y)a +/,.(x, j/)/3] ^ + |/:.v(®, y)« +/,«(*, y)/3] ^ 
= /«(*, J/)a* + 2/*»(x, j/)a|8 +/w(x, y)/S*, 

and 

F"'{t) = [/^(x, y)a* -h 2/^.(x, y)a|8 +/vv.(x, y)/3*] g 

+ J/)«* + 2/rOT,(x, y)a^ -f /ot«(x, y)/3*] ^ 

= /i*»(x, y)a* -f 3fxj^(x, y)a^fi -f- 3/*w(x, y)«/5* + 

/wv(®i y)/3’- 

Higher order derivatives of F{t) can be obtained by con¬ 
tinuing this process, but the form is evident from those already 
obtained. Symbolically expressed. 



* See Sec. 24. 
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F««) - («I + ^ !;)/(». »)-“•£ + C5«-^ aiS; 


where 


+ 

C? = 


^dy 

+ C- aS’^^ -^ + 8-^, 
+ 3xay“-i^^ d»» 


n! 


r!(n — r)! 
Since i = 0 gives x — a and y = h, 


F(0) = /(a, b), F'(0) = a/.(a, 6) + /3/,(a, 6), • • • . 

Substituting these expressions in (88-^) gives 
F(t) s f(x, y) = f(a, b) + [a/.(a, b) + 8fv (a, fe)]< 

+ [a*/„(a, b) + 2a8fUa, b) + 8^fyyia, b)] 

+ [«»/«.(«,l>) + 3cc^8f«^(a,b) + 3a8^f^(a,b) + /3y^(o, 6)]iJ 

+ • • • + Rnf 

where + |3 + Bed, b + Ofil). 

Since at = x — a and fit = y — b, the expansion becomes 
(88-4) fix, y) = fia, b) -f /*(c, 6) (a; - a) -f /»(a, b)iy - b) 

+ i)ix - o)* + 2/*v(a, b) (x - a){y - b) 

+ f„ia,b)iy - by] 

+ • • • -f- i?„. 

This is Taylor’s expansion for a function fix, y) about the point 
(o, b). Another useful form of (88-4) is obtained by replacing 
X — o by li and y — b by fc, so that x — a + h and y = b + k. 
Then, 

(88-6) fia + h,b + k)= fia, b) + Ua, b)h + A(a, b)k 

+ j^fUa, bW + V^ia, b)hk -f./„(o, 6)A:*J 

-f • • • -h Rn, 

where R„ = ^ + k ^"fia + 0h,b + 0k). 
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{88 


/(o + ft, 6 + fc) = /(a, 6) + (ft A + ft o, ft) 

+ • • • + Rn. 

In particular, if the point (a, b) is (0, 0), the formula (88-4) 
reads 


(88-6) /(*, y) = /(O, 0) + MO, 0)x + MO, 0)y 

+ ^[/«(0, 0)x* -I- 2/^(0, 0)xy +M(0, 0)y^] 

+ • • • + En, 


where = ^j(r ^ + ^), 0 < 9 < 1. 

This development is known as the Maclaurin formula for functions 
of two variables. It is seen from (88-6) that the Maclaurin 
formula expresses the function f{x, y) in a series each term of 
which is a homogeneous polynomial in x and y. 

The procedure outlined above can be generalized easily to 
yield similar expansions for functions of more than two variables. 


„yExample. Obtain the expansion of tan~* - about (1, 1) up 


to the third-degree terms: 


f(x, y) = 

/.(*! y) = 
/»(*. y) = 
/x»(3J> y) — 
Mix, y) = 
fnix, y) = 


tan“* -> 

X 

_ y—, 

X* + 2/*’ 

X 

+ y*’ 
2 xy 

(x* -f- yY 

w+w 

—2xy 
(x* + y*)*' 


/(I, 1) = tan-» 1 = 
Ml, 1) = -1; 

/.( 1 , 1 ) = 1 ; 

Mil, 1) = i; 

Mil, 1) = 0; 

MU. 1) = -g- 
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Then 

tan-‘ I = I - - 1) + - 1) 

+ ji[5(« - D' - \fy - !)■] + ■ • • . 
PROBLEMS 

1. Obtain the expansion for xy* + cos xy about ('•0 up to the 
third-degree terms. 

2. Expand/(x, y) = at (1, 1), obtaining three terms. 

3. Expand e* cos y at (0, 0) up to the fourth-degree terms. 

4. Show that for small values of x and y 

c* sin 1 / = y + xy (approx.), 

and 

* 2 /* 

c* log (1 + y) = y -f ^ (approx.). 

6. Expand /(x , y) = x^y + x*i/ + 1 about (0, 1). 

8, Expand \/l — x* — y* about (0, 0) up to the third-degree terms. 

7. Show that the development obtained in Prob. 6 is identical with 
the bino^rlial expansion of [1 ~ (x* + 

and Minima of Functions of Several Variables. 

A function/(x, y) of two independent variables is said to have a 
maximum at (a, 6), if 

A/ = f{(i + h,h + k) — /(o, 6) < 0 

for all sufficiently small positive and negative values of h and 
It is said to attain a minimum at (a, 6), if 

A/=/(a + h,h + k) -f{a, 5) > 0 

for all sufficiently small positive and negative values of h and k. 

Let it be assumed that /(x, y) attains a maximum (or a mini¬ 
mum) at (a, 6). Then the function of a single variable /(x, b) 
must attain a maximum (or a minimum) at a, and its derivative, 
if it exists, must vanish at x = a. Hence, a necessary condition 
for a maximum (or a minimum) is that 

(89-1) 


g = 0 at * = o, 
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provided that this derivative exists. A similar consideration 
of the function /(a, y) leads to the conclusion that 

(89-2) ^ ® ** ^ 

whenever the derivative exists. 

The equations (89-1) and (89-2) may be solved for a and b 
to 3 deld the desired values. This discussion can be extended 
in an obvious way to include the case of functions of any number 
of independent variables, so that one can formulate a theorem. 

Theorem. A function of any number of independent variables 
xi, X 2 , • • • y Xn attains a maximum or a minimum only for those 
values of the variables Xi for which 

^ . . . JL 

dxi * dXn 

either vanish simultaneously or cease to exist. 

In order to establish a criterion for distinguishing between a 
maximum and a minimum, note that Taylor’s formula gives 

(89-3) /(a + hyb + k)- f(ay b) = /.(a, b)h + /y(a, b)k 

+ b)h* -H 2U(a, b)hk +f„(a, b)k*] + R, 

where 

Since the vanishing of the first derivatives is a necessary condi¬ 
tion for a maximum or a minimum, (89-3) becomes 

(89-4) Af ^ /(o + A, b + A:) - /(a, b) 

= HI/«(o, b)h' + 2fzy{fl, b)hk +f„{a, i))fc*] + R. 

From the definition of a maximum it follows that Af < 9 for 
sufficiently small numerical values of h and k, whereas for a 
minimum it is necessary to demand that Af > 0. 

In order to simplify the discussion of the determination of 
the sign of Af, introduce new independent variables by means 
of the relations 


fc = r cos #>, 
k •= rmxup. 
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(89-6) A/ = cos* ip + 2B sin ip cos ip + C sin* ip + 


where 


A — fxx{p>i h)f 
B S fxy{Q>i V)f 
C - fyy(a, 6), 

and is a function that is bounded for sufficiently small values 
of r. 

If A 0, (89-5) can be expressed in the more useful form 

(89-6) A/ = ^ ^ - ^ j. 

Consider the following possible cases: 

(o) AC — J5* > 0. In this case the sign of 


(89-7) 


{A cos -f- J5 sin ^)* -f {AC — B*) sin* 
A 


is the same as the sign of A. But, since $ is a bounded function 

T 

for sufficiently snmll values of r, the numerical value of can 


be made as small as desired by choosing r sufficiently small. 
Accordingly, the sign of A/ will be determined by that of A. 
It follows then that the point (a, h) gives a maximum value of 
the function /(x, j/) if A < 0, and a minimum value if A > 0. 

(6) AC — jB* < 0. The first term in the numerator of 
(89-7) vanishes if 


(89-8) 


tan <p — 


A 

B' 


If ^ is one of the values satisfying Eq. (89-8), then the 
numerator of (89-7) will be negative, and by choosing r sufficiently 
small, the first term in the bracket of (89-6) can be made to 
dominate the expression. Therefore, for <p — <p\, bj will have 
the sign opposite to that of A. On the other hand, if ^ = 0, 
the numerator of (89-7) is positive, and hence, for ^ = 0 and 
sufficiently small values of r the sign of A/ is the same as that of A. 
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It follows that A/ does not maintain the same sign in the neighbor¬ 
hood of the point (a, 6), and consequently, this case gives neither 
a maximum nor a minimum. 

(c) AC — = 0. If AC — vanishes, then the numerator 

of (89-7) is either positive or zero. Therefore, it is necessary 
to investigate the behavior of the function ^ in order to be able 
to say anything about the sign of A/. Since the study of the 
function ^ is extremely involved and depends upon a very 
painstaking study of the higher derivatives of the function 
/(x, y), it will not be pursued here.* 

There remains to be considered the case when ^4 = 0. But a 
reference to (89-5) shows that, since 

2 B sin ip cos ip + C sin^ ip 


vanishes for some values of this case also leads to the investiga¬ 
tion of the function 4>. 

It is clear from the foregoing discussion that a maximum or a 
minimum will surely obtain if — ^4(7 < 0, that is, if 


D = < 0 . 

Vax dy) " ’ ' ’ 


dx^ dy^ 


U- 


-/2-2jc - 
Fig. 74. 



dH dH 

A maximum corresponds to the case in which both and ^ 

are negative, and a minimum to 
the case in which they are both 
positive. 

Example 1. A long piece of 
tin 12 in. wide is made into a 
trough by bending up the sides 
to form equal angles with the 
base (Fig. 74). Find the amount to be bent up and the angle 
of inclination of the sides that will make the carrying capacity 
a maximum. 

The volume will be a maximum if the area of the trapezoidal 
cross section is a maximum. The area is 

A = I2x sin 0 — 2x^ sin B + sin B cos 


* See (jOXTBsat, E. Cours d’analyse math4matique, vol. 1, 6th ed., pp. 
\1Q-116. 
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since 12 — 2x is the lower base, 12 — 2x + 2x cos 0 is the upper 
base, and x sin 0 is the altitude. Then, 


dA 

d0 


and 


dA 


= 12x cos 6 — 2x* cos 0 + x* cos* 0 — x* sin* 0 
= x(12 cos 0 — 2x cos 0 + X cos* 0 — x sin* 0) 

dA 


dx 


= 2 sin 0(6 — 2x + ® cos 0). 


,dA 


, =0 and = 0, if sin 0 = 0 and x = 0, which, from physical 

OX au 

considerations, cannot give a maximum. 

There remain to be satisfied 


and 


6 — 2x + X cos 6 = 0 


12 cos 6 — 2x cos 6 X cos^ 6 — x sin^ ^ = 0. 


Solving the first equation for x and substituting in the second 
jdelds, upon simplification, 

cos 0 or 6 = 60°, and a: = 4. 

Since physical considerations show that a maximum exists, 
x = 4 and 6 = 60° must give the maximum carrying capacity. 
Example 2. Find the maxima and minima of the surface 


Now, 





— — 1 ^ 

dx ^ c dy c 


which vanish when x = y = 0, But 

^ ^ ^ _L, 

dx^ a^c dy^ b^c dx dy 


Hence, D = 


1 

aW’ 


and consequently, there is no maximum 


or minimum at x == y = 0. The surface under consideration is a 
saddle-shaped surface called a hyperbolic paraboloid. The points 
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for which the first partial derivatives vanish and D > 0 are 
called minimax. The reason for this odd name appears from a 
consideration of the shape of the h 3 rperbolic paraboloid near the 
origin of the coordinate system. The reader will benefit from 
sketching it in the vicinity of (0, 0, 0). 


PROBLEMS 

1. Divide a into three parts such that their product is a maximum. 
Test by using the second derivative criterion. 

2. Find the volume of the largest rectangular parallelepiped that can 
be inscribed in the ellipsoid 


?! - 1 - ^ 4 - 1 * 
a*c* 


= 1 . 


3. Find the dimensions of the largest rectangular parallelepiped which 
has three faces in the coordinate planes and one vertex in the plane 


X V z 
r 4. £ -f I 


1 . 


4. A pentagonal frame is composed of a rectangle surmounted by an 
isosceles triangle. What are the dimensions for maximum area of the 
pentagon if the perimeter is given as P7 
6. A floating anchorage is designed with a body in the form of a right- 
circular cylinder with equal ends which are right-circular cones. If the 
volume is given, find the dimensions giving the minimum surface area. 

6. Given n points P< whose coordinates are *,«<), (i = l, 2, • • • ,n). 
Show that the coordinates of the point P(x, y, z), such that the sum of 
the squares of the distances from P to the P« is a minimiun, are given by 


n n n 

n2iy- n2i 

««i t-i t«i 



7. Let z « f(Zf y) be the equation of a surface which has a minimum at 
the point (0, 0). Then every plane containing the 2 -axis will intersect 
the surface in a curve which has a minimum at (0, 0). The converse of 
this statement is not true, as can be seen by examining the surface 

2 = (y - x*)(y - 2»*) 

in the neighborhood of the origin. Show that there exists no two- 
dimensional neighborhood of the point (0, 0) in which the values of this 
function are all of the same sign. 
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90. Constrained Maxima and Minima. In a large number of 
practical and theoretical investigations it is required that a 
maximum or minimum value of a function be found when the 
variables are connected by some relation. Thus, it may be 
required to find a maximum of w = /{x, y, s), where x, y, and a 
are connected by the relation <p(x, y, z) == 0. The resulting 
maximum is called a constrained maximum. 

The method of obtaining maxima and minima described in 
the preceding section can be used to solve a problem of con¬ 
strained maxima and minima as follows: If the constraining 
relation ^(x, y, 2 ;) = 0 can be solved for one of the variables, 
say 2 , in terms of the remaining two variables, and if the resulting 
expression is substituted for z m u /(x, y, 2 ), there will be 
obtained a function u = F(x, y). The values of x and y that 
yield maxima and minima of u can be found by the methods of 
Sec. 89. However, the solution of <p{x, y, 2 ) = 0 for any one 
of the variables may be extremely diflSclilt, and it is desirable to 
consider an ingenious device used by Lagrange. 

To avoid circumlocution the maximum and minimum values 
of a function of any number of variables will be called its extremal 
values. It follows from Sec. 89 that the necessary condition 
for the existence of an extremum of a differentiable function 
/(xi, X 2 , • • • , Xn) is the vanishing of the first partial derivatives 
of the function with respect to the independent variables xi, 
X 2 j • • • , Xn. Inasmuch as the differential of a function is 
defined as 


df s dxi + dx2 + • • • + dxn% 

^ dxi ^ ^ dX2 dXn ' 

it is clear that df vanishes for those values of Xi, Xa, • • - , Xn 
for which the function has extremal values. Conversely, since 
the variables x< are assumed to be independent, the vanishing 
of the differential is the necessary condition for an extremum. 

It is not difficult to see that even when some of the variables 
are not independent, the vanishing of the total differential is 
the necessary condition for an extremum. Thus, consider a 
function 


(90-1) 


tt = fix, y, z), 
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where one of the variables, say z, is connected with x and y 
by some constraining relation 


(90-2) 


<p{x, y, z) = 0. 


Regarding x and y as the independent variables, the. necessary 

- . du ^ du ^ 

conditions for an extremum give = 0 and — = 0, or 


ax~ dx'^ dz dx ~ 
du _ df . df dz _ ^ 
dy~dy'^Tzdy~ 


Then the total differential 


dx+^dy 


)- 0 , 


and, since the expression in the parenthesis is precisely dz, it 
follows that 


(90-3) 




The total differential of the constraining relation (90-2) is 


(90-4) 


^ dx + ^ dy + ^ dz = 0. 
dx dy ^ dz 


Let this equation be multiplied by some undetermined mul¬ 
tiplier X and then added to (90-3). The result is 

(i +I?)+ (i + ^ If)+ (I + ^ If) 

Now if X is so chosen that , 


(90-6) 


I ^4-X^ = 0 

dx^^dx 

dy^^dy 

4- = 0 

dz^^ dz 

<p(.x, y, z) = 0, 
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then the necessary condition for an extremum of (90-1) will 
surely be satisfied. 

Thus, in order to determine the extremal values of (90-1), 
it is merely necessary to obtain the solution of the system of 
equations (90-5) for the four unknowns a:, y, z, and X. The 
multiplier X is called a Lagrangian multiplier. 

Example 1. Find the maximum and the minimum distances 
from the origin to the curve 

bx^ + bxy + by’^ — 8 = 0. 

The problem here is to determine the extremal values of 
f{x, 2/) = X* + 2/* 
subject to the condition 

y) = 5x2 ^ -I- _ g - 0 . 

The equations (90-5) in this case becolne 

2x -f- X(10x -f- 6 y) = 0, 

2y + X(6x + lOy) = 0, 

5x2 ^ ^y2 __ g = 0. 

Multiplying the first of these equations by y and the second by x, 
and then subtracting gives 

6X(2/2 - x^) = 0, 

so that y = ±x. Substituting these values of y in the third 
equation gives two equations for the determination of x, namely, 

2x2 = 1 and x2 = 2. 

The first of these gives / = x 2 -f y 2 — i second gives 

/ = a ;2 -f- 2/2 _ 4 Obviously, the first value is a minimum, 
whereas the second is a maximum. The curve is an ellipse 
of semiaxes 2 and 1 whose major axis makes an angle of 45® 
with the x-axis. 

Example 2. Find the dimensions of the rectangular box, with¬ 
out a top, of maximum capacity whose surface is 108 sq. in. 

The function to be maximized is 


fix, y, z) = xyz, 
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subject to the condition 

(90-6) xy -H 2 x 2 -j- 2yz = 108. 

The first three of the equations (90-6) become 

( 1/2 + X(l/ + 22) = 0, 

(90-7) \ X 2 -j- X(x 2z) = 0, 

{xy -f X(2x -I- 2y) = 0. 

In order to solve these equations, multiply the first by x, the 
second by y, and the last by z, and add. There results 

X(2xj/ + 4x2 -f- iyz) -f- 3xyz = 0, 
or 

X(xi/ -f- 2x2 -1- 2yz) -f ^xyz = 0. 

Substituting from (90-6) gives 

108X + ^xyz = 0, 
or 

"72" 

Substituting this value of X in (90-7) 
factors gives 

l-^iy + 22 ) 

1 - ^(X -I- 22) 

1 - ^(2x + 2y) 


and dividing out common 


= 0 , 
= 0 , 



From the first two of these equations it is evident that x = y. 

18 

The substitution of x = y in the third equation gives ^ ~ 

Substituting for y and z in the first equation yields x = 6. Thus 
X = 6, y = 6, and 2 = 3 give the desired dimensions. 


PROBLEMS 

1. Work Frobs. 1, 2, and 3 of Sec. 89 by using Lagrangian multipliers. 

2. Prove that the point of intersection of the medians of a triangle 
possesses the property that the sum of the squares of its distances from 
the vertices is a minimiun. 
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3. Find the maximum and the minimum of the sum of the angles 
made by a line from the origin with (a) the coordinate axes of a cartesian 
system; ( 6 ) the coordinate planes. 

4. Find the maximum distance from the origin to (a) the folium of 
Descartes x* + y* — 3axj/ = 0; ( 6 ) the ellipse 

llx» + 6 x 2 / + 32 /* - 12 x - 122 / - 12 = 0 . 

6 . Find the shortest distance from the origin to the plane 

ax + by + cz d. 


91. Lagrange’s Multipliers. The discussion of the preceding 
section, showing that the vanishing of the total differential is 
the necessary condition for an extremum, is perfectly general 
and can be extended immediately to the function/(xi,X 2 , • • • ,Xn) 
of n variables, several of which may not be independent. 

Thus, consider a function 

(91-1) w = f(x, y, z, u), 

and let the constraining relations be 


(91-2) 


y, z, u) = 0 , 
y, z, u) = 0 . 


The relations (91-2) will be thought of as defining the variables 
2 and u as functions of the independent variables x and y. Then 
the necessary conditions for an extremum are 


or 



and 


dw 

By 


0 , 


dw _ df . df dz . df du 
dx dx dz dx du dx 

dw _ r Bf ^ , df 
dy dy dzdy dudy 


Multiplying the first of these equations by dx, the second by 
dy, and then adding, 

(91-3) dw ^ ^dx + ^dy + ^^dz + ^du = 0. 
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The constraining relations (91-2) give 


(91-4) 


dx dy dz ' du ’ 

^dx + ^dy + ^dz + ^du = 0. 
[dx dy ^ dz du 


Multiplying the first of the equations (91-4) by Xi and the second 
by X 2 , and adding the resulting equations to (91-3), 

+ (i +Is + *■’to) 

This equation is satisfied if Xi and X 2 are so chosen that 

l^f J. ^ _L \ _ n 


4 . \ 4- \ - n 

^ r*^ -4- \ 4- X - 0 

^du du du 

The four equations (91-5), together with the two constraining 
relations (91-2), can be used to determine the values of x, y, 
z, w, Xi, and X 2 , which give extremal values of (91-1). 

The procedure just outlined can be extended in an obvious 
way to cover the case of more than two constraining relations 
and more than four variables. This discussion leads to the 
following rule: 

Rule. In order to determine the extremal values of a function 

(91-6) fi^U ^2> * * ’ > ^n) 

whose variables are subjected to m constraining relations 
(91-7) ipi{xx, a;2, * • • , Xn) =0, (i = 1, 2, • • • , m), 
form the function 


F — f + ]^Xi <pif 



s«l 


APPLICATIONS OF POWER SERIES 


333 


and determine the 'parameters X,- and the values of X\, Xt, - Xn 
from the n equations 


(91-8) II = 0, O' = 1, 2, ■ • • , n), 

and the m equations (91-7). 

As an illustration, consider the problem of determining the 
maximum and the minimum distances from the origin to the 
curve of intersection of the ellipsoid 


4- ^ 4. ?! 


= 1 


with the plane 

Ax + By + Cz 0. 

The square of the distance from the origin to any point 
(ar, y, z) is 

f = x^ + y^ + z< 

and it is necessary to find the extremal values of this function 
when the point (x, z) is common to the ellipsoid and the plane. 
The constraining relations are, therefore, 

/ j >2 i »»2 ^2 

(«) + + 


and 

(6) ^2 = Ax + J5t/ + C 2 = 0. 

The function F = / + Xi^i + \ 2^2 is, in this case, 

r.,= + j,. + .= + x,(g + |J + g-i) 

+ 2X2(Ax + By + Cz), 

where the factor of 2 is introduced in the last term for con¬ 
venience. Equations (91-8) then become 

1 ^ “f” ~ 

CL 

y + 

z + Xi-o “i" ~ 
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These equations, together with (a) and (6), give five equations 
for the determination of the five unknowns x, y, Zy Xi, and X 2 . 
If the first, second, and third of equations (c) are multiplied by 
Xj y, and 2 , respectively, and then added, there results 

+ y^ + ft 2 + By + Cz) = 0. 

Making use of (a) and (6), it is evident that 
Xi = + y^ + z^) = 

Setting this value of Xi in (c) and solving for x, y, and z, 


*(‘ - io 

1 + \iA = 0, 

or 

X = 

X2-4a* 

0 * 

<(' - 4 

1 + X 2 P = 0, 

or 

y = 

6* -/’ 


1 + X 2 C = 0, 

or 

z = 

XjCc* 

c^-f 


When these values of x, 2 /, and z are substituted in (5) one obtains 
^2 _ y -r 52 _ ^ + ^2 _ y- 

from which / can be readily determined by solving the quadratic 
equation in /. 


PROBLEMS 

1. Find the point P, in the plane of the triangle ABC, for which the 
sum of the distances from the vertices is a minimum. * 

2. Find the triangle of minimum perimeter which can be inscribed 
in a given triangle. 

* See E.Goursat^s Mathematical Analysis, vol. 1, English ed., p. 130, for a 
detailed discussion of this interesting problem. 



CHAPTER X 

IMPROPER INTEGRALS 


In defining the definite integral, assumed that 

the function/(x) remains bounded in the interval (a, 6), and that 
the end points a and b of the interval are finite. If either (or 
both) of these assumptions is not satisfied it is necessary to 


attach a new interpretation to the symbol ^V(^) dx. If the 

function f(x) becomes infinite in the interval a ^ x ^ by ot if 
the limits of integration become infinite, then the symbol 

^/(x) dx is called an improper integral. It will be seen that 


the improper integrals are defined as limits of certain functions 
which arise from a consideration of ordinary definite integrals. 

92. Integral with Infinite Limit. If the function f{x) is 
bounded* and integrable for x ^ a, then the symbol 


(92-1) 


JJ‘fix)dx 


is defined by the equation 


If this limit exists, then the integral (92-1) is said to converge; 
otherwise it is called a divergent integral. The divergent integral 

can arise in two ways. It may happen that J[/(^) becomes 

infinite with 6, or it may be that this integral oscillates without 
approaching any limit. Thus, 

* The definition of an integrable function f(x) (Sec. 35) demands that 
fix) be bounded; hence, the statement that the function is hounded and 
integrable is redundant. However, some authors extend the class of func¬ 
tions integrable in the sense of Riemann to include those unbounded func¬ 
tions whosO'improper integrals exist (see Sec. 94). The word hounded is 
inserted here to preclude the possibility of interpreting the term integrable 
function in the extended sense. 
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f = lim r‘-^ = lim (2V5 - 2Vo). 

Jo WX ^^Jay/X 

The expression within the parentheses becomes infinite with 6. 
On the other hand, for 

* sin a: dx = lim sin x dx = lim (cos a — cos 6) 

the expression in parentheses oscillates as h is increased and does 
not approach any limit. Both of these integrals are called 
divergent. However, 


C" xdx C 

Jo (**+!)» iTiJa 


xdx 


(** + D* 

+ D* “ (6* + 1)*] 


converges to the value 
Similarly, 


4(o* + 1)* 

/! ,/(^) dx 

is defined as the limit of the function dx when a becomes 

negatively infinite, so that 

dx = lim ^V(^) 

It may happen that the integral ^V(^) a bounded function 
f(x) exists for all finite values of a and b; in that case the symbol 


f’j(x) dx 


is understood to mean 


(92-2) J(x) dx + £ 7(®) dx, 

where c is any real number. 

It is clear that a study of an improper integral with a con¬ 
tinuous integrand f{x) reduces to a study of the behavior of the 
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limit of the function F{x) as x—> oo, where F{x) = 

The conditions under which a function F{x) converges to a 
limit have been discussed in Chap. I, and a direct application 
of the fundamental principle of convergence to a limit furnishes 
the following theorem. 

Theorem 1. A necessary and sufficient condition that J ^fix) dx 

he convergent is that, for any arbitrarily small positive number e, 
there exist a number N such that 

dx^ < € 

for all values of p and q which both exceed N, 

However, the application of Theorem 1 to the determination 
of the convergence of a particular integral is likely to be difficult. 
For this reason some simple practical tests are developed with 
the aid of Theorem 1 and the following theorem. 

Theorem 2. If f{x) is continuous for x a and '\f{x)\dx 

exists, then f J{x) dx also exists. The function f{x) is then said to 

be absolutely integrable over the infinite interval. 

In order to prove this statement, write 

/(x) = [fi=o) + |/(a;)l] - L^(x)|. 

Then 

(92-3) dx = £lf(.x) + |/(a:)l] dx - £\fix)\ dx. 

By hypothesis the second integral in the right-hand member of 
(92-3) converges when 6 —> oo. But 

0^m + \fix)\ ^2!/(x)l; 

hence 

i*h . 

Since the integral \ 2|/(x)| dx is convergent as 6 oo, it follows 

that the first integral in the right-hand member of (92-3) also 
converges. 

The converse of Theorem 2 is not true. The integral of f{x) 
may converge over an infinite interval when the integral of 
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|/(a;)| does not converge. This corresponds to the situation 
in infinite series when a series converges conditionally. 

As an instance of such behavior consider the integral* 


(92-4) 




which is convergent but not absolutely convergent. The con¬ 
vergence of the integral (92-4) will be established with the aid of 
Theorem 1. 

It follows from the second mean-value theorem for integrals 
(Sec. 37) that 

f Sin X , 1 ^ 11 ^ 

jp « vjp gJe 

where 0 < p ^ ^ ^ q. But 

sin X dx| ^2 and sin x dx| ^ 2. 


Consequently, 


dx ^ 21 




Now if any € > 0 is prescribed, the inequality 


dx < € 


will surely be satisfied for all values of p and q that are greater 

4 

than iV = -• Thus, the integral (92-4) is convergent, f 


• It is customary to define the value of at x » 0 as unity, so that 

X 


is a continuous function. 


t It will be shown in Sec. 97 that 


Jo X 
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In order to prove that 
(92-6) 


r 

sin X 

Jo 

X 


dx 


diverges, note that for any positive integral value of k 

(*+l)irl 


X 


sin x\ 


dx 


Jo X Jr X 


dx + 

+ 


r(k+l)r 

sin X 

Jkr 

X 


dx 


- 2 X 

n —0 


(n+l)»| 


Sin X 


dx. 


Now, for n ^ 0, 

•(n+l)»l 

(92-6) 


f 


Sin X 


dx ^ 


X 


_2_ 

(n+ (n + lV 

1 . 


since the minimum value of - in the interval [nir, (n -|- 1 )t] 

X 


IS 


(n + l)ir 
k 

2 X 

n —0 


It follows that 


^Cn+l)x 

sin X 

/nr 

X 


dx ^ 


+ ■ ■ ■ +m) 


and, since the series in the right-hand member of this inequality 
diverges as A; —> oo, the integral (92-5) is also divergent. 

It may be remarked that the function f{x) need not approach 

zero as a: —» oo in order that the integral V(®) be convergent. 
Consider, for example, the integral 

*sin x^ dx, 

and assume that it can be written as the sum of a series of inte¬ 
grals, namely, 


(92-7) 


f"sinx»d*= V 
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The series in the right-hand member of (92-7) is readily shown to 
be convergent, but the integrand of (92-7) obviously does not 
approach zero as x —► oo. 

In order to prove the convergence of the series, let the variable 
X be changed by the substitution 


X = Vz + nir. 


J V(n4-l)T 

si 

fe/nir 


^Jo V z + riTT 
_ 1 [*’'(“-!)’' sin z ^ 
^Jo Vz + riT 


2jo 

It is clear from this form of the general term of the series that 
the series in the right-hand member of (92-7) is alternating and 



Fig. 75. 

decreasing in such a way that the limit of the nth term as 
n 00 is zero. Consequently, the series and, hence, the integral 
(92-7) converge. 

The question of the legitimacy of the infinite series representa¬ 
tion (92-7) of the integral sin x^ dx will be settled in Sec. 96, 

but it is not at all necessary to resort to this method of establish¬ 
ing the convergence. In fact, a substitution of x^ ^ y leads to 

a consideration of the integral 1 — dy, which is readily 

Jo Vy 

shown to be convergent.* 

* See the illustration at the end of Sec. 93 and Kxample 2 of Sec. 96. 



§98 


IMPROPER INTEGRALS 


341 


The reason for the convergence of this integral may be seen 
from geometrical considerations (Fig. 75). The areas bounded 
by the successive arches of y = sin decrease with the increase in 
n, because the difference of consecutive roots, \/(n + l)7r — 
of sin tends to zero when n—^co^ while the maximum height 
of each arch always remains equal to unity. 

93. Tests for Convergence of Integrals with Infinite Limits. 
This section contains some practical tests for determining the 

convergence of the integral f(x) dx, where/(x) is a continuous 

function for all values of x ^ a. It will be assumed throughout 
this section that a is a positive number. This entails no loss 

of generality, since the integral ( f(x) dx, where the lower 

Jao 

limit ao is negative, can be written as the sum of two integrals, 
namely 

r*/(x) dx = p/(^) dx + fy(x) dx, 

Jaa Jolq a/a 

where a is a positive number. 

Theorem 1. If f{x) is continuous for x > a and there exists a 
positive number A such that 

\f{x)x^\ < A when x > a, 


X QO 

/(x) dx converges absolutely if k > 1. If |/(x)x*| ^ A 

and k ^ 1, then the integral /(x) dx diverges. 

The proof of the theorem is simple. For, if 


l/WI < 


then 

(93-1) 

But 

(93-2) 


r l/(a:)| dx < ^^dx. 

Ja Ja ^ 


and, if fc > 1, the right-hand member of (93-2) approaches the 

"" 1 

limit 1 ) k-i when 6 . Thus, the integral on the 
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right of the inequality (93-1) exists, and, since J[*l/(®)| dx is 
an increasing function of *, the integral \ dx exists. It 

follows from Theorem 2, Sec. 92, that /(x) dx exists. 

The proof of the second part of the theorem is just as easy. 
For 

l/(®)l ^ 4 when X ^ o. 

X 

Therefore, 

JW)ldx^ Aj^‘ldx. 

But if |/(a;)| ^ then/(x) cannot change sign for x ^ a, since 

fix) is a continuous function. Suppose that/(x) > 0; then 
nh rh 

J \fi^) \ da; = J fix) dx 2: A J ^ dx. 

But 

= log 6 — log o, if fc = 

which diverges as 6—> oo. Consequently, ^Jfix)dx diverges. 
If fix) < 0 for a: ^ a, then 

j^‘|/(x)| dx = dx, 

and the assertion that J^fi^) dx diverges follows immediately 

from the proof for the case when fix) > 0. 

This theorem is capable of a simple geometrical interpretation. 

If l/(x)l < then the graph of the function y = fix) lies 

A 

between the graphs of y = (Pig. 76). Consequently, 
the area under the curve y “ bounded by the ordinates 
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les 

X = a and x == 5 and the x-axis, is greater than the area under 
the curve y = |/(a;)l, so that 

J] !/(*)! ^ 

If the integral on the right of this inequality is convergent, 
then the integral on the left will surely converge. 



If, on the other hand, 

f{x) ^ ^ for x'2i a, 

then the area under the curve y = fix) will not be less than that 
under t/ = -r? so that 

X* 

A particularly useful form of Theorem 1 appears when /(*) 
is such a function that lim x’‘S{x) exists. In such a case Theorem 1 

» go 

can be phrased as follows: 

Corollaary. If lim n^fix) = L, where k >1, tiien f'"f(,x)dx 
converges absolutely. 
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If lim xV(x) = L 7 ^ 0 and fc ^ 1, then \f(x) dx diverges. 

X’-* • 

As an illustration of the application of this corollary consider 


’ dx 

(1 + 




(?+0 


H = 


it follows that the given integral is convergent. 

The reader will have no difficulty in deducing, with the aid 
of the corollary, the following useful theorem. 

jp ex') 

Theorem 2. If f(x) = where Pi(x) and P^ix) are poly^ 

X 2\X) 

nomials in x and Pi^x) 0 for x ^ a, then the necessary and 
sufficient condition that f{x) dx converge is that the degree of 

P^ix) exceed the degree of Piix) by at least two. 

Theorem 3. If fix) is continuous for x a and there exists a 
positive number A such that \e^^fix)\ < A when a: ^ a, then 

dx converges absolutely if h > 0. If |e**/(a:)| ^ A^ 

then "/(^) diverges t/ A; ^ 0. 

The proof of this theorem follows by using the argument 
employed in establishing Theorem 1, and by noting that 


dx = 


k ^ 0, 
A; = 0. 


Corollary. If lim /(a;)6** = L and k > 0, then f^fix) dx 

X—* «o 

converges absolutely. 

//lim/(x)6** = L 0 and A; 0, then / /(^) ^ diverges. 

As an illustration consider 


lim e*e~^ *. lim 
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it follows that the given integral is convergent. 

Theorem 4. If ip{x) is a monotone function which approaches a 
finite limit as x increases indefinitely, then 

<p(x)dx 

mil converge f{x) dx converges. 

The proof of this theorem follows from Theorem 1, Sec. 92, 
with the aid of the second mean-value theorem for integrals 

(Sec. 37). The convergence of f(x) dx requires that there 

exist a number N such that when p and q are any numbers 
greater than N, then 

But 

|^V(a:)/(a:) dx\ = dx + <p(q)f^f(x) dzj 

where p, and q are all greater than JV. Then, if L is the limit 
approached by (p(x) as x increases, and if is the larger of |L1 
and |^(a)|, it is evident that 

Therefore, 

\fj<p(x)f(,x) dx| < 

if p and q are any numbers greater than N. 

By a similar argument it can be shown that if (p{x) is a mono¬ 
tone function which approaches zero as x increases indefinitely, 

then dx converges if J^/(x)dx remains bounded 

as b increases indefinitely. It should be noticed that this state¬ 
ment does not require that f^f(^) dx converge to a limit as b 
is increased. 

For example, the integral 
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where fc > 0, can be written as 


X 


-r sin X dx. 

1 X* 

Since ^ is a monotone function which approaches zero as x 

increases, and since sin a; dx = cos 1 — cos 6 which oscillates 

as h increases, it follows that the given integral is convergent. 
The convergence of this integral was discussed in Sec. 92 for the 
case in which A; = 1. 

As another example, consider 

This integral can be written as 

= e**^%~**c~x* dx. 

Now c ** is a monotone-increasing function which approaches 
the limit 1 as x increases, and ^**«~** dx was shown to converge. 
Hence, 

is convergent. 

PROBLEMS 

Test the following integrals for convergence or divergence: 


1 

2 . 

3. 

4. 


r"c08 X 

■ Jl 

/; 


xVl + 

xdx 


X \/2 + x‘ 

I e“»* sin X dx. 
1 

X (1+ 

6 . 

Jl X 


7 . 

8 . 
9. 

la 


11 . 

18 . 


C *sin X 

j. ■?-*• 

Jo 1 + X* 
r* tan-«x 

Jl 1 + X* 

X'? 

X' 

f" dx 

X iTi*' 


Bin X 
Tx 

' dx 

vm 


dx. 


dx. 
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94. Integrals in Which the Integrand Becomes Infinite. If 

f(x) becomes infinite for some value of x = c, where a < c < b, 
then, by definition, 

(94-1) Cf{x) dx = lim P “/(x) dx + lim P /(x) dx, 

and the integral is said to exist if the limits of the two integrals on 
the right-hand side of (94-1) exist. In case /(x) becomes infinite 
at X = a, then, by definition, 

fyix) dx = Urn dx, 

and if /(x) becomes infinite at x = 6, 

j^f{x) dx = lim */(x) dx. 

It may be observed that, since 

lim P /(x) dx = lim [F(b) — F(a + €)], 

where F{x) is the indefinite integral of /(x), the integral con¬ 
verges if lim F(a + €) exists. If the indefinite integral can 
€—♦0 

be found, the evaluation of the definite integral is accomplished 
in the process of determining its convergence. 

It is important to note that the variables ci and C 2 in the 
definition (94-1) are assumed to approach zero independently 
of one another. The same variable € is used occasionally in 
the definition, so that 

(94-2) dx = lim */(x) dx + dx^. 

But the limit in (94-2) may exist when the limits in (94-1) do 
not exist. If the limit in (94-2) exists and is equal to L, then 
the value L is called Caxichy^s principal value of the integral 

£f{x) dx. 

If /(x) becomes infinite at both end points of the interval 
but remains bounded within (a, 5), then the integral of /(x) 
is defined by the equation 

j^V(x) ® ^ 
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where each of the limits on the right must exist if the integral 
is to converge. 

The definitions given above can be extended in an obvious way 
to include the case where fix) has any finite number of dis¬ 
continuities in the interval (a, 6). 

Example 1. 

= lim = lim (i - A 

Jo J« .-^0 V / 

Hence, the integral does not exist. 

Example 2. 

dx ^ ^ /A 


^2 - X 


= lim r - = lim (—2\/t + 2\/2Y 

*-^0 Jo V 2 — X *-*0 \ ) 


and thus the integral converges to 2\/2- 
Example 3. 


X dx 

J. “ Us. J. 


+ lim r 


(x^ - 1)H • ;:ro - 1)W 


= + 1 ] 

Therefore the given integral is convergent to 
Example 4, 

r | = + fg 

J — 1 ^ «i—►O J — 1 X ct—^0 J cs ^ 

and therefore, the given integral does not converge. But if 
6j = €i = €, then 

/ » 

is equal to zero. 

~lX 
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It is clear from the foregoing that the determination of the 
convergence of improper integrals, with discontinuous integrands, 
is reduced to the study of the behavior of the limit of the function 
F(«) as « ^ 0, where F(«) is of the form 

F(0 = dx. 

From the definition of the limit of a function (Sec. 8) and from 
the fundamental principle of convergence (Sec. 5), it follows that: 

The necessary and sufficient condition that lim F(c) exist is that, 

•-♦ 04 * 

for any ^reassigned positive number rj, one can find a number 6 
such that 

|Ffe) - F(*,)l < r, 


whenever 0 < €2 < €i < 5. 

Recalling the definition of F(c) one can state the following 
theorem: 

Theorem. A necessary and sufficient condition for the conver-- 
gence of the integral 

pjix) dx 


whose integrand becomes infinite at x = a is that for any pre~ 
assigned number t; > 0, one can find a positive number 8 such 
that 



< V 


whenever 0 < €2 < ci < 5. 

It follows from this theorem that if \f{x)\ dx is convergent, 

then J^f(x) dx will surely converge. The converse of this 
statement, however, is not true. For, consider the integral 



dx. 


Setting ^ ^ y gives the integral 
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which was shown to be convergent, but not absolutely convergent 
(see Sec. 92). 

96. Tests for Convergence of Integrals Whose Integrands 
Become Infinite. Corresponding to the tests given in Sec. 93 for 
the convergence of integrals with infinite limits, one can develop 
tests for the convergence of integrals whose integrands become 
infinite in the interval of integration. One of these tests is 
given next. 

Theorem. If f(x) is continuous for a < x Sh and there exists a 
positive number A such that \f(x)(x — a)*| < A for 0 < k < 1 and 

a < X ^ b, then r/w dx is absolutely convergent. 

If \f(x)(x — a)*l > A for k ^ 1 and a < x ^ b, then dx 

is divergent. 

The proof of this theorem is entirely similar to that of Theorem 
1, Sec. 93. It is only necessary to observe that 


dx 

Ja (X - 


exists if Aj < 1 and does not exist if ft ^ 1. 

Corollary. If lim (x — ayf{x) = L, then f^f(x) dx converges 

z-*a+ 

absolutely if 0 < k < 1, 

If lim (x ~ ayf{x) = L 0, then f^f(x) dx diverges if k I, 
Example 1. Consider 

n dx 
Ji y/z? — 1 

Since 

lim (a: — ^ = lim ^ = = -4=> 

\/x’‘+ X + 1 's/a 

it follows that the given integral is convergent. 

Example 2. Consider 

f ^sin X , _ - 

—— dx, n > 0. 


sin X sm x 


Now 
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sin X 

But, since lim-= 1, it follows that 

X--0 ic 


lim 

x-*0 


sin z 
z^ 


/ . sin z 
= lim I z^ - 

x-*0 \ ^ 

= lim 

X —>0 



This limit will exist provided that n — 1 ^ A;. Thus, if n < 2, 
the integral is convergent, and if n ^ 2, the integral is divergent. 
Ezample 3. Consider 



sin z 

Since lim x* log x = 0 if fc > 0, and lim- = 1, it is evident 

x-»0 x~^0 X 

that lim x* log sin x = 0, when A; > 0. Consequently the integral 

X-+0 

converges. 

PROBLEMS 

1. Test the following integrals for convergence or divergence: 
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2. Prove the convergence of the integrals 
(o) jE? = f ~ **** 0 < e < 1; 

Jo Va* - 


( 6 ) 


X' 


dx ^ 1 

\/(l - «*)(! - eV) « 


0 < 6 < 1 . 


These integrals are known as the elliptic integrals of the second and first 
. kinds, respectively. 

3. Prove the convergence of the integrals 


(a) 


Q>) 


dd 


_ 

Jo a/I — e* sin* 6 


0 <e <1; 


c* sin* 6 dd, 


0 < c < 1. 


Set X = sin 6, and use the results of Prob. 2. 

4. If P(x) and Q(x) are relatively prime polynomials, show that 

r^pcx) 

I prj-r dx diverges whenever a root of 0(aj) falls in the interval 
Ja VW 
a x ^ h. 


96. Operations with Improper Integrals. Inasmuch as the 
improper integrals are defined as the limits of certain functions, 
it is natural to inquire whether it is permissible to perform the 
same operations on improper integrals as are familiar in the case of 
finite integrals. It is clear from a consideration of the examples 
in Sec. 92 that the behavior of some improper integrals is closely 
analogous to that of infinite series, and this fact alone is sufiS^cient 
to indicate the need of caution. 

It is true that the equation 

£cf{x) dx = cj^ix) dx, 

when c is a constant, is valid, even when the integrals are 
improper, since in applying the limit process, the constant e can 
be placed either inside or outside the limit sign. 

The equation 

(96-1) Lfi(a:) + fa(x)] dx = ^ ^ 

however, is not always true. It may be that ^(x) = /i(x) + /i(x) 
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is a function whose integral converges, whereas the integrals 
of /i(x) and/ 2 (x) are divergent. Thus, 


is divergent, as is 


r * dx 

J2 ^-1' 


is convergent. However, if any two of the integrals in (96-1) 
converge, then the third integral also converges, and Eq. (96-1) 
is true. Similarly, if any two of the expressions in the formula 
for integration by parts, 

(96-2) fyi(x)f't(x) dx = /i(x)/j(a:)|‘ - fy'iix)fi(x) dx, 

exist, then the third expression also exists and the relation (96-2) 
is valid. 

Matters are considerably more involved when one considers 
the differentiation and integration of improper integrals with 
respect to a parameter, and it is necessary to impose more severe 
restrictions on the integrands than was the case with the ordinary 
integrals. Thus, consider an integral containing a parameter, 
namely, 


(96-3) FC 


. r*sii 

“> - j» - 


where 


a > 0. 


If the differentiation under the integral sign be performed 
formally there results the integral 

cos ax dx, 

which is divergent and consequently does not represent the 
function F'(a).* 

* It may be remarked that the function defined by the integral (96-3) is a 


constant. For. setting z ^ ax gives 
Consequently, F (a) 6. 


r * sir 
ives I — 

Jo S 


dz, which is independent of a. 
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The difficulty encountered here is essentially of the same 
sort as that appearing in the differentiation of series term by 
term. In fact, it will be shown next that a study of the con¬ 
vergent improper integrals of the form 

(96-4) F(a) = a) dz, 

where /(x, a) is a continuous function for x ^ a and for every 
value of a in the interval ao ^ a ai, is equivalent to the study 
of a series of integrals. 

Let 


d = Oil K, CL^ ^ 0>z • K. CLn • • • 

be any increasing sequence of numbers such that 

dim an = 00 . 


Then the integral (96-4) can be written as an infinite series of 
integrals, namely,* 

(96-5) r V(^i «) «) a) dx + • • • 

•fa Ja^ai •fat 

+ a) dz + • • • 

n-1 

Now each term of the series in the right-hand member of (96-6) is 
a continuous function, so that 


(96-6) £y(x,a)dx^ ^u„(a), 

n»l 

* It is important to note that the requirement that the integral be con¬ 
vergent is essential if one is to reduce the study of the integral to that of the 

series. For example, sin xdz\a divergent, but the series 


+ • • • + sin » <i* + • • • 

n-0 ^ 

has its sum equal to zero. Accordingly, s: sanxdz 9 ^ 


n^O 
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«n(a) = a) dx 

JOn 


(ao ^ a ^ ai). 


If the series ^ Unia) is uniformly convergent, then the function 

n*l 

F(a) will surely be continuous. Accordingly, one can borrow 
the terminology of infinite series and say that the integral (96-4) 
will define a continuous function if it is uniformly convergent. 
This, of course, means that the series (96-6), which represents 
the integral, is uniformly convergent. Inasmuch as the con¬ 
struction of the series (96-6) is not unique, it is more convenient 
to define the uniform convergence of the integral (96-4) as follows: 

Definition. The integral f{x, a) dx converges uniformly in 

the interval ^ a S a\ if, corresponding to any € > 0, one can 
find a number N, independent of a, such that 

1 ^ /(*. «) < e 

for every value of a in the interval (ao, otu) whenever p ^ N, 

Jf the integral fix, a) dx converges uniformly, then the 

series (96-6) will also converge uniformly, so that for any c > 0, 
one can find a number N independent of a such that 


Rn 


9—n 




whenever n N. 

As in the case of uniform convergence of series, the definition 
does not provide a useful test for uniform convergence. A 
simpler test for uniform convergence of integrals follows directly 
from the Weierstrass test for series. 

Weierstrass Test for Integrals. If fpix) is a positive and 
continuous function for x N, and if \fix, a)| ^ ^(x) for 
ao ^ a ^ ai and x N, then 

fix, a) dx 
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is uniformly and absolutely convergent for every a in the interval 
(ao, ai) ‘provided that <p(.x) dx converges. 

It was remarked earlier that the function F(a), defined by the 
integral (96-4), will surely be continuous in the closed interval 
(«o, cti) if the integral converges uniformly. 

Using the notion of uniform convergence of improper integrals 
and noting Theorems 2 and 3, Sec. 70, it is easy to establish the 
following suflicient condition for integrating and differentiating 
under the integral sign. 

Theorem. Let fix, a) be continuous in x and a for at ^ a ^ ai 
and for aU values of x ^ a; then 

FM = “) 

can be integrated under the integral sign with respect to a in any 
interval (fii, P 2 ) contained in (ao, «i) to yield 

if «) dx is uniformly convergent in (ao, ai). 

Moreoverj if J ^ dx converges uniformly for every value 


dx converges uniformly for every value 


of a in the interval (ao, ai) and fa is continuousy then 

_ r «) 


Some applications of this theorem to the evaluation of improper 
integrals are indicated in the next section. 

PROBLEMS 

1. Establish the uniform convergence of the following integrals: 

(a) 6"** cos osz dx; 

(b) f^’‘e-‘‘dx, a>0; 

(c) J^*’e““*x*dx, a > 0. 

2. Integrate cos x* dx, (b > a), by parts and obtain 

r* , , 1 • r, 1 • . I 1 r*8in X* , 

I cos *• dr “ sin 6* — — am o* -b I —— dr. 

Jo 26 2o 2ja ** 
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Deduce from the result the convergence of the integral ^ cos dx, 

3. Use integration by parts to show that ^ cos x log x dx diverges. 

4 . Use integration by parts to show that cos x log xdx converges to 

- r^dz. 

Jo ^ 

97. Evaluation of Improper Integrals. This section is con¬ 
cerned with the evaluation of several improper integrals that 
cannot be calculated directly with the aid of the fundamental 
theorem of the integral calculus. It will be seen that the theorem 
of the preceding section plays an important part in nearly all 
the examples considered below. 

Example 1. Let it be required to evaluate the probability 
integral 

(97-1) 

The convergence of this integral has already been established, in 
Sec. 93, but it will be profitable to attack the problem in a 
different way which will lead to an estimate of the magnitude of 
the number J. 

Now 


fje-^'dx = £e-^'dx + 
But, if X lies between 0 and 1, then 

dx < 


and 


j; 


xe''*'dx = 




Furthermore, if 0 a: ^ 1, then e“*’ ^ 1, so that 

JJV-ix < 1. 

CJonsequently, 

(97-2) 
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Similarly, if 1 ^ x < «>, then 

0 < ^ "e~** dx < *xe“*’ dx. 

The integral J^'‘xe~**dx can be calculated with the aid of 
the fundamental theorem to give 

f"xe-dx = l. 

Ji 2e 

Hence, 

(97-3) ® /i ^ 

It follows from (97-2) and (97-3) that 

The exact value of (97-1) will be obtained with the aid of 
the following ingenious device. Since I is not a function of 
the variable of integration, one can write 

(97-4) 7 = 

Multiplying (97-1) by (97-4) gives 

Transforming to polar coordinates by means of 

z = r cos 6 
y = r sin 0, 

and noting that the integration extends over the area of the first 
quadrant of the ajy-plane gives* 

/* = = |- 


* See Sec. 46. 
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The same device can be used to evaluate 




Example 2 . Evaluate 


ip(«) = X' 


x^e~^^*dx 


for a ^ ao > 0 . Since for any a > 0 there exists a number N 
such that ^ \ for x ^ N, it follows that ^ ~ for 

X N, Moreover, 


converges, and therefore, the given integral converges uniformly. 
Then, assuming the existence of the integral. 


J ’* 00 ^ to p * 

ip{a) dot = \ I 

a */0 


Hence, 


Example 3. Evaluate 


da dx = I xe“®** dx = 


Aa) = 


^(a) = "*e""** cos ax dx. 

^'(a) = ~ sin ax dx 


and, since 

Ixe"** sin ax\ ^ xe”*‘, 

whose integral is convergent, the differentiation is justified. 


By integration by parts. 


(a) = 7 : 6 “** sin ax 

A I 




COS axdx ^ 2 ^( 101 ). 
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But if 


then 


_ atp 
" 2 * 


dip 

</> 



or 

log ip = + Cl 

and 

ip = cr*. 

In order to determine C, consider 


But 



e~*'dx — 




(See Example 1.) 


^(0) = Ce" * C, 


and, therefore, 



W 


Example 4. Evaluate 

(97-6) F{ci, dx, where a ^ 0. 

Without lose of generality j8 may be assumed to be positive, 
since a change in the sign of /3 merely changes the sign of the 
integral. Now 

(97-6) — cos Sx dx, 

and, since for a fixed a > 0, 

|e-~ cos Sx\ ^ e-", 

which is independent of fi, the differentiation under the sign is 
valid. 
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The evaluation of (97-6) is easy. For 





cos fix dx = e~“ 


P sin fix — a cos Px 

+ 


a 

«* + /3*’ 


Hence, 

= J-5-^,d/S = tan-^^-FC. 


But F(a, 0) = 0 and, since (97-5) defines a continuous function 
of P, 

lim F{a, p) = 0 = tan“‘ - + C. 

/J-K) CL 


Thus 


C = 0. 


Consequently, 

(97-7) F(a, P) = tan-‘ a > 0. 

CL 


It follows from (97-6) that 
(97-8) ^(0,^) = 

and if it is demonstrated that (97-5) defines a continuous func¬ 
tion of a (for all a ^ 0 and for a fixed jS), then (97-7) will afford 
a means of calculating the integral (97-8). But, by breaking 
the interval of integration in (97-6) into subintervals of lengths 

^7 (97-6) can be written as 

* (n-Hl)y 

(97-9) F(a, P) = 2X, 

n-0 'J 

and it is not difficult to show* that the numerical value of the 


* If the substitution x 
follows almost immediately. 


nir 


s H-is made in the integral, the assertion 
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nth term of the series is less than — Furthermore, the series 

n 

is alternating and decreasing, so that the sum of the terms 

beginning with the (n + l)st is less than —which is inde- 

n + 1 


rr/3)~V2 


F(ah-% 


Fio. 77. 


pendent of «. Hence, the series (97-9) converges uniformly and 
thus defines a continuous function for « ^ 0.* Accordingly, 


F(0, j9) s r — — dtx = lim tan~‘ - 

a/0 ^ o-+0-f CL 


= if jS > 0, 

= if /3 < 0, 

= 0, if ^ = 0. 

The function defined by ( dx is discontinuous at 

Jo * 

P = 0 (see Fig. 77). This integral is of importance in the theory 
of Fourier series. 

Example 6. As an example of an integral with a discontinuous 
integrand, consider 


(97-10) 


Jol - X 


* It should be noted that the continuity of F (a, (for a fixed 0) does not 
ensure the uniform convergence of the integpral (97-5). As a matter of fact, 
the integral is uniformly convergent if a ^ 0, but this has not been demon¬ 
strated above. Instead of constructing the series, one could prove the 
uniform convergence of (97-6) and thus deduce the continuity of F(a, 0), 
This can be done with the aid of the second mean-value theorem for inte¬ 
grals. See, for example, H. S. Carslaw, Fourier Series and Integrals, 2d ed., 
p. 184. 
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= I+ x + x^ + ••• + x^ + ^ -; 

L X 1 — X 


hence, 


r log_x _ r xdx + r X log xdx + 
joi’-x Jo Jo 


J "1 a-n+l 

x^ log x dx + I ‘z -log X dx. 

0 Jo 1 ““ 


If it is established that 


lim jRn = lim I - -log x dx = 0, 

n—» 00 n—»00 Jo A X 


(97-11) dx = J X" log X dx 

n—0 

= -2^=' 


where the last step results from integration by parts. 

The proof that lim i2n = 0 is accomplished without much 

n—♦ 00 

trouble if one notes that 




x"+’ 

Ja 


log X dx, 


where o is a positive number less than unity. Now 

log xdx < o"+i pi^ dx, 

Jol - X ^ Jo 1 - X 

and, since o < 1, the expression* on the right tends to zero 
as n—> 00 . 


•NoteProb. 1 O'), Sea 96. 
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The reader will show that — is bounded if 0 < a ^ a; ^ 1, 

and hence, the second integral in the right-hand member of 
(97-12) likewise tends to zero as oo. This completes the 
proof of the validity of formula (97-11). 

The function 


f(») - 2^ 


has been studied by Riemann and is called the Riemann zeta- 
function.* Thus the value of I is — f(2). 

PROBLEMS 


1. Verify the values of the integrals given below: 


(6) I = 


a+1 


a > —1; 




(e) e-«* sin X dx = a > 0; 

if) -dx = logii, a > 0,/3 > 0; 

Jo X a. 


cos fixdx = e 




a >0- 


(A) I xe~"*‘ dx 


-> a > 0. 


2. Let 


^ p logd+g 
jo 1 + ** 


•See, for example, E. T. Whittaker and G. N. Watson, A Course of 
Modem Analysis, Chap. XIII. 
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Differentiate this integral with respect to a, and evaluate the resulting 
integral. Hence, show that 


log (1 + x) T log 2 
1+x^ 8 * 


3. Assuming that 


Jo 


is valid for complex values of a s a + W = where a ^ 0, show that 


0 2\r 

Set a — 0 and 6 = 1, and obtain the Fresnel integrals 

cos ax — I sm X* oa? =- - 

Jo ‘ 2\/2 


4. Using the formula 


show that 


6. Show that 


1 if", . 

— = - I 6“®* dx, 
a* 2J0 ' 

2 1=1 r * 

n® 2J0 — 1 

n — 1 

fss;**.?. 


Hint: Integrate by parts, and use 


X 2 


98. Improper Multiple Integrals. Let/(x, y) be a function of 
two variables x and y which is continuous at every point of a 
two-dimensional region R, bounded by a closed curve C, except 
at the point Q((, r{) where /(x, y) becomes infinite. The symbol 

(98-1) jj^Kx,y)dS, 

where dS is the element of area of the region 22, is called an 
improper double integraL 
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Let an arbitrary infinite sequence of closed curves Ci, Cj, 
• • • , C„, .. • be drawn in R in such a way that each curve 
Cn encloses the point Q({, rj) and where each curve lies entirely 
within the preceding one. Furthermore, let the greatest linear 
dimension of the region Rn enclosed by Cn tend to zero as n 



increases indefinitely (Fig. 78). Denote the closed region which 
is exterior to Cn and interior to C by 

R Rny (w = 1, 2, • • • ); 

then the function/(a;, y) will be continuous in the regions R — 
and the double integral 

will exist for every value of n. 

If 

n—♦ «0 

exists for an arbitrary choice of the regions /?n, then (98-1) 
is said to converge. It follows from the definition of the limit 
that the convergence of (98-1) means that for any € > 0 one can 
find a positive number h such that 

(98-2) y) d<s| < €, 

for every subregion R' of B which does not contain Q and which 
lies within the circle of radius S with center at Q. 
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(M 

If f(x, y) contains a parameter a, where ao ^ a ai, then 
the convergent improper integral defines a function of a. More¬ 
over, if the choice of the radius S of the circle is independent 
of the choice of a in (ao, ai), then the integral 

y, a) dS 

will be said to converge uniformly. A uniformly convergent 
double integral defines a continuous function of a, and it may be 
integrated under the integral sign with respect to a. The 
differentiation under the integral sign is permissible if the 
derived integral, namely, 



converges uniformly. 

These considerations can be extended to cover the case of 
improper double integrals containing a finite number of param¬ 
eters. An extension of the definition of an improper integral 
to functions of more than two variables is likewise immediate. 

Thus, if f(x, t/, 2 ) becomes infinite at the point 0({, r}, f), but 
is continuous at every other point of a three-dimensional region 
R containing Q, then the symbol 

(98-3) fj(x, y, z) dV, 

where dV is the element of volume, is called an improper triple 
integral. If Rn (where n = 1, 2, • • • ) is a sequence of regions 
bounded by the closed surfaces Snj which are constructed in a 
manner entirely analogous to the construction of the curves Cn 
in the definition of the two-dimensional case, then (98-3) is 
said to be a convergent triple integral provided that 

/I 

n—♦ «0 JK'—Kn 

exists independently of the choice of the regions 
The following test, giving a suflScient condition for the con¬ 
vergence of an improper triple integral, is used frequently in 
applied mathematics. 

Test for Convergence. Let f(x, y, z) be a continuous function 
at every point P{x, y, z) of the region R with the excejdion of the 
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Voivt 0({, ij, t), where fix, y, z) becomes infinite. If there exists a 
positive constant A such that 

(98-4) |r»/(x, y,z)\ < A, 

where r — 's/(x — {)* + (y — i?)* + (a — f)* and n < 3, then 
the integral 

(98-5) fjix, y, z) dV 

is convergent. 

The proof of this test follows from the criterion of convergence 
analogous to (98-2). Indeed, if the integral (98-5) is to converge, 
then for an arbitrary « > 0, 

!/«,/(*, y, z) dv\ < e 

for every three-dimensional subregion iZ' (of jB) not containing 
Vy i) a-iid lying within the sphere S of radius 5 whose center 
is at Q. But if the inequality (98-4) is satisfied, then 

(98-6) 

Since fZ' is only a part of the region bounded by the sphere S, 
and since the integrand is positive, it follows that 


(98-7) 



The integral on the right of this inequality can be evaluated 
easily in spherical coordinates, since* 



sin $ dr d$ dip 



But if n < 3, then the magnitude of the right-hand member of 
(98-7) can be made as small as desired by choosing the radius b 
small enough. It follows from (98-7) and (98-6) that 

|p(x, y ,.) dvl 


♦ See Sec. 49. 
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can be made as small as desired, and this establishes the conver¬ 
gence of (98-5). 

The reader will show, by using a similar argument, that 
an improper double integral will surely converge if 

\fix, y)I < 

where n < 2, is a positive constant, and r is the distance 
from P to Q. 

As an illustration of the application of the theory of this 
section, let it be required to calculate the gravitational attraction 
on a unit mass located at a point P(a;, y, z) due to a distribution 


P(x.y.z) 



Fio. 79. 

of mass of density p contained within the volume V (Fig. 79). 
Denote the coordinates of the points of the volume V by ({, rj, f ); 
then the density p is a continuous function of rj, and f and the 
element of mass dm of the body is 

dm = pdV. 

The attraction at the point P, due to an element of mass dm, 
is given by the inverse square law, namely, 

dm __ p({, f) 

r2 - ^2 



where r = y/{x — {)* + ( 2 / — t?)* + (« — f)*. The components 


870 ADVANCED CALCULUS {M 

of the force of attraction along the coordinate axes are* 
dm X — i dm y — v dm z — t 

— • - j ..i_ • - ■ » - • - • 

r r* r r ^ 

hence the force X in the direction of the x-axis is 

(98-8) X = ~ d7, 

with similar expressions for the components of force in the direc¬ 
tions of the 2/- and 2 ;-axes. 

The variables of integration in (98-8) are f, and f, so that 
the element of volume dV can be expressed sls drj df. If the 
point P is outside the volume F, so that r never vanishes, then 
the integral (98-8) is proper. If, however, P is chosen within 
the body, then the denominator of the integrand in (98-8) 
vanishes when li — rj y, and f = 2, but it is not difficult 
to show that the resulting improper triple integral converges. 
Indeed, let the maximum value of p(f, rj, f) be A ; then 

l.LzI 

r2 r 

and, since the exponent of r is less than 3, the integral (98-8) 
will surely converge. 

The potential €>(x, y, z) at the point P due to a distribution 
of mass of density p is defined by the equation f 

(98-9) ^(x, y,z)= ( 

Jr r 

and (98-9) is certainly convergent at all interior points if p 
is a continuous function. 

It is important to note that the maximum density A is inde¬ 
pendent of the location of the point P(x, y, z), so that the integrals 
(98-8) and (98-9) converge uniformly for all values of the param¬ 
eters X, y, and z. Accordingly, the potential $ and the com¬ 
ponents of force X, Y, and Z are continuous functions of x, y, 
and z throughout all space. 

* See p. 202. 
tSeep. 208 
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Since 



which are precisely the expressions that one obtains by differen¬ 
tiating (98-9), under the integral sign, with respect to the param¬ 
eters Xj yy and z. The differentiation under the integral sign 
is clearly justified since (98-8) converges uniformly. Con¬ 
sequently, one can write* 


If the point P is outside the volume 7, the integrals (98-10) 
are proper and hence can be differentiated under the sign. Thus, 


dx 




dY dZ 

with similar expressions for — and 


But 


Kr) ^ 3(x ~ _ I 

dx* r* r*’ 


* See p. 203. 
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and the expressions for 



are similar. 


Hence. 


^ ^ ^ 
dx'^ dy'^ dz 


0 , 


and a reference to (98-11) shows that 


(98-12) 


dx^ dy^ dz^ 


This is the celebrated partial diflEerential equation of Laplace. 

If the point P is interior to the body, the differentiation of 
(98-10) under the integral sign is not legitimate, and the equation 
(98-12) is no longer satisfied unless p = 0. 


PROBLEMS 

1. Prove that the force of attraction at a point P, exterior to a Homo- 

M 

geneous sphere, is P = where R is the distance from the center of 

the sphere to the point P and M is the mass of the sphere. 

2. If the force of attraction exerted by an element of mass dm on a 

1c dm 

point is —where r is the distance from the element of mass to the 

point, find the attraction of (a) a homogeneous right-circular cone upon 
a point at the vertex; (6) a homogeneous right-circular cylinder upon a 
point on its axis. 

Ana, (a) 2jrA;pA(l — cos a), where h is the altitude and 2a is the angle 
at the vertex; 

(6) 2fjrkp[h -t- -f — \/(P + hY + a® ], where h is the 
altitude and a is the radius of the cylinder, and R is the dis¬ 
tance from the point to one base of the cylinder. 

3. Find the force of attraction on a unit mass located at a point within 
the cavity of a homogeneous spherical shell. 

4. Find the potential due to a homogeneous spherical shell at all 
points exterior to the shell, and within the cavity. 

6. Find the potential at the points on the axis of a homogeneous cylin¬ 
drical shell. 

99. Gamma Functions. An interesting function, which pro¬ 
vides a generalization of the factorial, is defined by the improper 
integral 
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(99-1) r(a) = dx, where a > 0, 

and is called the Gamma function. 

If a is a positive number less than unity, the integrand of 
(99-1) becomes infinite at the lower limit a; = 0, so that it becomes 
necessary to investigate the behavior of the integral at both 
limits. Accordingly, (99-1) will be written as the sum of two 
integrals, namely, 

(99-2) r(a) = dx, 

the second of which has a continuous integrand for all values of 
x ^ 1. Moreover, this second integral converges if a > 0 
since* 


lim x\e~^x*^~^) = lim = 0. 

X—* “0 X —► * 

If a ^ 1, the first integral is proper, since its integrand is 
continuous. It remains to investigate the behavior of the 
integral 

(99-3) 

when 0 < a < 1. Now 

lim =0, if fc -h a — 1 > 0, 

*-♦0 

and this condition is surely satisfied ifl—a<fc<l. It 
follows from the corollary to the theorem of Sec. 95 that (99-3) 
is a convergent integral. 

It is also clear that (99-1) diverges if a 0, so that (99-1) 
defines a function for positive values of a only. However, 
it is possible to define the function r(a) for negative values of a 
with the aid of the recursion formula which will be developed 
next. 

If a > 0, then it follows from (99-1) that 
(99-4) r(a + 1) = 

* See corollary to Theorem 1, Sec. 93. 
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Integrating the right-hand member of (99-4) by parts gives 
dx — — -|- aj^"x“~h~* dx 

= aj^‘‘x“~*e~* dx 

= «r(«). 

Thus, 

(99-6) r(a -I- 1) = ar(a). 

But 

r(l) = ^Je-*dx = 1, 

SO that when a = 1, the formula (99-5) becomes 

r( 2 ) = 1 • r(l) = 1 . 

Setting a = 2, 3, • • • , n gives 

r(3) = 2 r( 2 ) = 1 - 2 , 
r(4) = 3r(3) = 1 * 2 • 3, 


r(n) = (n - l)r(n - 1) = (n -- 1)!, 
r(n + 1) = nr(n) = nl 

Hence, the formula (99-6) enables one to compute the values of 
r(a) for all positive integral values of the argument a. 

If by some means (for example, by using infinite series) the 
values of r(a) are obtained for all values of a between 1 and 2, 
then, with the aid of the recursion formula (99-5), the values of 
r(a) are readily obtained when a lies between 2 and 3. Knowing 
these values, it is easy to obtain r(a) where 3 < a < 4, etc. 
The values of r(a) for a lying between 1 and 2 have been com¬ 
puted* to a high degree of accuracy, so that it is possible to find 
the value of r(a) for all a > 0. 

It remains to define r(a) for negative values of a. The 
recursion formula (99-5) can be written as 

(99-6) r(a) = n£L±i). 

ce 

The formula (99-6) becomes meaningless when a is set equal to 
zero, since 

lim r(a) + 00 and lim r(a) — oo, 

* Sxnall table is found in Peirce’s ^'Table of Integrals,” p. 140. 
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It follows from (99-6) that the function r(—'a) is discontinuous 
when a is a positive integer. 

If any number — 1 < a < 0 is substituted in the left-hand 
side of (99-6), the right-hand side gives the value of r(--a), 
since the values of a + 1 lie between 0 and 1, and r(a) is known 
for these values of a. Thus, 

2/ ^ “ -0.9’ * 

In this manner the values of T(a) for —1 < a < 0 can be com¬ 
puted. Knowing these values and using the recursion formula 
(99-6), the values of r(a) for 
— 2 < a < —I can be obtained, 
etc. The adjoining figure rep¬ 
resents the graph of r(a) (Fig. 

80). 

It was observed that 
T(a + 1) = a! 

when a is a positive integer. 

This formula may serve as the 
definition of factorials of frac¬ 
tional numbers. Thus, 

rm = H'; 
r()i) - {-HV; 
r(i) = 0 ! ^ 1. 

This section will be concluded with an ingenious method* of 
evaluating }^l Now 

= r(%) = J^“‘e-*x^dx. 

If the variable in this integral be changed by the transformation 
X = y*, the integral becomes 

(99-7) H\^2f\-yYdy 

Since the definite integral is independent of the variable of 
integratiop and is a function of the limits, 



See also Sec. 97. 
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(99-8) = 2^%-*’2*d2. 

Multipl3ring (99-7) by (99-8) gives 

(H!)* = 4^%-2M2^“e-''Vdy, 

which can be written as a double integral 

(99-9) (H!)' = 4j^“Jo"c-(>'’+*’>j/*2* dy dz. 

In order to evaluate (99-9), transform it into polar coordinates 
by setting 2 = r cos B and y = r sin B. The element of area 
dy dz becomes r dr dB, and (99-9) becomes 


But 


and 


(MO* = drj\^e~'^ sin^ B cos^ B dB. 




sin* B cos* 0 dB = 


16 


X' 


e“*’V* dr « 1. 


The latter integral is evaluated by integration by parts. There¬ 
fore 


i.V 


4! = 


or 


1 , _ 


2 ' 


It can be shown with the aid of the recursion formula that 

(-H)! = v^. 

m- • 

PROBLEMS 

1. Compute the values of r(«) for every integer and half integer from 

0 to 6 by using the relations r(l) - 1 and r(H) = Plot the curve 

y r(a) with the aid of these values. 

2. Tlie beta-function B(m, n) is defined by the integral 

B(m, n) - J^**"“‘(l *■ *)•“* 
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If X is replaced by y* in T(n) = dx, there results 

r(w) = 2^ dy. 

Using this integral, form 

r(m)r(n) = dxj^ dy. 

Express this product as a double integral, transform to polar coordinates, 
and show that 

_ p/,, _ r(w)r(n) 

B(m. n) - Bin, m) - 

3. Show, by a suitable change of variable, that (99-1) reduces to 




4. Show that 


d"r(a) 

da** 




dy. 


»«”‘e”»(log a)** dx, 


and justify the differentiation of (99-1) under the integral sign. 



CHAPTER XI 


FOURIER SERIES 

100. Criterion of Approximation. It is already known* that a 
suitably restricted function f{x) can be represented in a series 
of ascending powers of x. The restrictions imposed upon f(x) 
are quite severe inasmuch as it is assumed that the function 
not only possesses derivatives of all orders, but also that the 
remainder in the expansion converges to zero uniformly, f It 
is obvious that a function that is capable of a power-series 
representation can be approximated arbitrarily closely in a given 
interval by a polynomial of sufficiently high degree. The 
criterion of the closeness of approximation in this case consists 
of the requirement that the numerical value of the deviation of 
the values of the function from those of the polynomial (that 

n 

is, the remainder 2?n(x) ^ fix) — made less 

than some specified amount for all values of x in the given 
interval. 

The question naturally arises whether it is possible to represent 
a given function/(x) by a trigonometric polynomial of the formj 


( 100 - 1 ) Snix) = ^ + 2 

A-l 

where au and bk are real constants so selected as to satisfy some 
criterion of the goodness of approximation. 

It should be observed that since every term in the right-hand 
member of (100-1) is a periodic function of period 2r, Snix) 


* See Chap. IX. 
t See Sec. 82. 


t The reason for writing the constant term as will appear in the next 


section. 


878 
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is also periodic.C!onsequently, only periodic functions f{z) 
of period 2ir can be approximated by a polynomial of the form 
(100-1). Or, what amounts to the same thing, one can restrict 
the problem of approximating a nonperiodic function f{x) 
to some interval of width 2ir and define the function /(x) outside 
this interval so that it is periodic. It will be assumed from this 
point on that the problem of approximating /(x) by a trig¬ 
onometric polynomial is confined to the interval (—ir, tt) and 
that outside this interval the function /(x) is defined by the 
equation/(x + 2ir) = /(x). Of course, any interval (a, a + 2ir) 
will do equally well. 



In formulating the problem of approximating /(x) by a trig¬ 
onometric polynomial S„(x), one could demand that the coeffi¬ 
cients Gk and bk be so chosen as to satisfy the requirement that 
the difference 8n(®), between the values of the function /(x) 
and the polynomial Sn(x), does not exceed a prescribed amount 
for all values of x in the interval (—tt, ir). However, such a 
criterion would regard the dotted curve shown in Fig. 81 as 
constituting a better representation of the function /(x), shown 
by the solid line, than the wavy dotted line approximating the 
same function /(x) in Fig. 82. For it is clear that the maximum 
deviation of the approximating function shown in Fig. 81 is 
less than the corresponding maximum deviation shown in Fig. 82. 

It appears more reasonable to set up as a criterion for the 
goodness of approximation the magnitude of the integral of the 
absolute value of 5n(x), namely, 

' «»(*)! *!. 

• A function is taid to be periodic of period a if /(*) ■■ f(x -|- a). 
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since this integral represents the shaded area between the curves 
5n(x) and /(x). The closer the approximating curve lies to 
/(x), the smaller the magnitude of the integral will be. However, 
a study of integrals containing absolute values of functions in 
the integrand is quite difficult, and it is customary to consider 
the integral of the square of 5 n(x) instead of the integral of its 
absolute value. Accordingly, it will be agreed that the “best"’ 
approximation for the function /(x) by means of a trigonometric 
polynomial Sn(x) is that polynomial in which the coefficients 
Qk and hk are so selected as to make the magnitude of the integral 

( 100 - 2 ) U = y_[Ux)Ydx 

n 

fix) ~ ^ COS kx + 6* sin kx) j dx 



a minimum. 

Therefore, the problem of determining the coefficients in 
(100-1) is reduced to that of minimizing the function In of 
2n + 1 variables a* and 6*. The following section is concerned 
with this problem of minimizing the integral (100-2). 

101. Fourier Coefficients. Let /(x) be an integrable* (and 
hence bounded) function defined in the interval — tt ^ x ^ 
and let 5n(«) be the trigonometric polynomial 


n 

^ + 2 (a* cos kx -f bk sin kx), 

k-l 


where the coe£Scients Ok and bk are to be selected so as to render 
the integral 


(101-1) In - J' [/(*) “ I* “ 2 ** + ^ 

a TniniTnnm. 


«Smp. 110. 
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aoi- 2 ) 


1 


Calculating the partial derivatives gives 

f ~ ^ X 1 

' ° jfc-i 

n 

— —2^ |^/(^) ^ (®* CO® H" sl^ J cos kx dx, 

jb-l 

(fc - 1, 2, . . . , n), 
n 

f =» — 2^ j^/(^) “ ^ ^ (®* COS fcx -f hk sin kx) J sin kx dx, 

(A; - 1, 2, ... , n). 

But it is known that 

! J^ cos kx cos mx dx = 0, if k 9 ^ m ; 

= IT, . if k = m 7 ^ 0 ; 

sin /fcx cos mx dx = 0 ; 

sin kx sin mx dx = 0, if k 7 ^ m; 

~ TTj if k ” m- Oj 

so that carrying out the integrations indicated in (101-2) gives 


I dcLo 


=-/-■ 


(101-4) 


fix) dx -|- iraol 

r 

dl 

= —2 I /(x) cos kx dx + 27rafc, 

O0>k J-w 

(k = 1 , 2 , 


1 


= -C 


/(x) sin A;x dx + 2x6*, 

(fc = 1, 2, 


, n); 


, n). 


The necessary condition for a minimum of In (see Sec. 89) 
requires that these derivatives vanish, and this leads to the 
following values for the coeflScients: 


( 101 - 6 ) 


(“* - ifj 


/(x) cos kx dx, (A; = 0, 1, 2, 


, n)\ 


\bk =* ~J* fix) sin kx dx, (fc = 1, 2, • • • , n). 
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It follows immediately from (101-4) that the coefficients a* 
and hk so obtained make (101-1) a minimum, since 

= 27r, (fc = 1, 2, • • • , n), 

whereas all the mixed derivatives of the second order vanish. 
The constants a* and bk defined by the formulas (101-5) are 
called the Fourier coefficients of the function f{x). 

Some insight into the character of the approximation of a 
function f{x) by the trigonometric polynomial can be gained 
by expanding the integrand in (101-1) and integrating those 
terms which are free of /(x). The result is 


dHn 

dal 

dal 


r [/(^)]^ dx — Oo f /(x) dx 

u c/ —»■ 


/(x) cos kx dx + I fix) sin kx dx 


ib-l 

n 

ib-l 


J /(x) sin A;x dx j 


which, upon substitution from (101-5), gives the important 
formula for the magnitude of the integral of the square of the 
deviation. 


(101-6) /„= r [/(*)]* -I-2 («2+ *>?)} 


Since J» is never negative and the sum ^ (aj + bl) is an 

increasing function of n, it follows that In is a monotone-decreas¬ 
ing function of n. Consequently, the approximation .of fix) 
by the trigonometric polynomial 

n 

Sn(.x) = ^ + 2 ** *** 
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where the coefficients are determined by (101-5), improves with 
the increase in the number of terms of the polynomial. 

Moreover, it follows directly from (101-6) that the series 
of the squares of the Fourier coefficients. 


(101-7) ^ + ^(al + bl), 

converges whenever f(x) is an integrable function. For, since 
^ 0, it is evident that 

n 

(101-8) I + 2 (a| + bl) S ir_mx)V dx. 

ifc-1 

Now the left-hand member of the inequality (101-8) is precisely 
the nth partial sum of the series (101-7), and since it is bounded, 
the convergence of the series (101-7) fellows directly from 
Theorem 1, Sec. 62. Furthermore, the terms of any convergent 
series form a null sequence, so that the Fourier coefficients of 
any integrable function f{x) tend to zero with increasing n. 

It was shown* by Liapunoff, in 1896, that the limit of /« 
as n increases indefinitely is zero, so that the following remarkable 
formula is true whenever/(x) is an integrable function. 

00 

^ J_V(x)]* d* = f + 2 

*-1 

However, the fact that the integral of the square of the devia¬ 
tion tends to zero when the number of terms in the trigonometric 
polynomial is increased indefinitely does not establish the 
convergence of the Fourier series 

•0 

(101-9) ^ 4- (o* coskx + bkem fee). 

k-l 

In fact» if fix) is merely an integrable function, the Fourier 
series may fail to converge either at some points of the interval 


* See Whittakbb, E. T., and Watson, G. N., Modem Analysis, p. 170. 
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or even in the entire interval (—t, tt). Even if the Fourier 
series (101-9) does converge, its sum is not necessarily/(a;). 

In order to establish the convergence of (101-9), it is necessary 
to impose some additional restrictions on the function /(x). 
There are several sets of sufficient conditions which will ensure 
convergence of the Fourier series. One of the most celebrated 
of these is due to Dirichlet, and it is set forth in the following 
section. The discussion of the next section makes use of the 
following theorem. 

Theorem. 7/ /(x) is an integrdble function in the interval 
a ^ X ^ P, then the integrals J*^/(^) cos nx dx and sin nx dx 

tend to zero as n increases. 

If the interval (a, 0) is of length 2ir, then it follows from (101-5) 
that* 


cos nx dx = f(x) cos nx dx = anir, 

and it was noted above that the Fourier coefficients of an inte- 
grable function form a null sequence. If the interval (a, fi) 
is of length less than 27r, define the function (p(x) in the following 
way. Let <p(x) = f(x) in the interval (a, jS), and let (p(x) = 0 
at all other points of the interval of length 2t. Then 



cos nx dx 


= <p{x) cos nx dx = OnTT, 


and it follows as before that an —> 0 as n . If (a, p) is an 
interval of length greater than 2 wj then it can be broken up into 
a finite number of intervals of lengths less than or equal to 2 w. 
Then the integral 



can be expressed as the sum of a finite number of integrals of the 
t 3 rpe considered above, each of which tends to zero as n —> oo. 
The proof for the integral 

X'-fw sin nxdx 

is entirely similar. 

* It will be recalled that the function /(«) is assumed to be periodic of 
period ir. 
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102. Conditions of Dirichlet. 

Theorem. Let f(x) he a function defined arbitrarily in the 
interval and outside this interval defined by the 

equation f{x + 2ir) = f{x). If f(x) has a finite number of 'points 
of ordinary discontinuity and a finite number of maxima and 
minima in the interval then it can be represented by 

the series 

00 

^ (ajb cos kx + bk sin fcx), 

jfc-i 

with 

1 f' 

a* = - I f{t) cos ktdty 

u “IT 

6* = - j /(<) sin kt dt, (A: = 0, 1, 2, ■ • • ), 

—T 

which converges at every point x = Xo of the interval to the value* 

/(xo+) +/(xo-) 

2 


The restrictions imposed upon the function f{x) in this theorem 
are known as the Dirichlet conditions. 

In order to establish the theorem it is necessary to show that 
for any x in the interval 


lim Sn{x) 

n-* «p 


/(X+) +/(X-) 

- --, 


where 


(102-1) Sn(x) = ^ + (o* cos kx + bk sin kx). 

ifc-i 


* lff(x) is continuous at the point re = Xo, thcn/(xo+) =/(iCo—) =/(rb), 
so that at all points of continuity the series converges to f(x). At the 
points of ordinary discontinuity it converges to the arithmetic mean of the 
values of the right- and left-hand limits. 
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Substituting the values of o« and in (102-1) gives 

n 

iS„(x) = ij* (cos A:« cos Ax -h sin kt sin kx) j (ft 




COS k{t — a?) 


The expression appearing in the bracket can be summed with 
the aid of the trigonometric identity* 




(2n + l)tt 


2 8m 2 


so that Sn{x) can be written as 


Sn(x) = - 


Setting f — X = 2w, gives 




sin (2n -f 1)- 


o • < — ® 

2sm-^ 


(102-2) 5»(x) 


If ‘ /(, + 2„)5iL®t±i^d„. 

sm u 


Thus the study of the limit of Sn(x) as n —► oo is reduced to 
the study of the behavior of an integral of the form 


u/l \ 

sin -I “ + cos u + cos 2u -h • • - 4* cos nu I 

+ 2i[ sin (fc +i)u - sin -0«] 
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(102-3) 

Jo sm« ’ 

when m is allowed to increase indefinitely. This integral is 
known as the integral of Dirichlet, and a study of it reveals that 
the limiting value of (102-2) as « is precisely equal to 
/^l/(®+) +/(®~)]- Unfortunately, a detailed discussion of 
the integral (102-3) is very involved,* and for this reason the 
convergence of (102-2) will be established under the h 3 rpothesis 
that /(x) is a differentiable, and hence, continuous, function. 

Consider first the function F(x) = 1. All the Fourier coeffi¬ 
cients, with the exception of oo, of such a function vanish, so 
that (102-2) gives the identity 

i=ir' 

tJ-»-* Sinu 


which is valid for all values of n. If both sides of this identity 
are multiplied by/(®), there results 

(lOW) + 

rj -r-x sm w 


Subtracting (102-4) from (102-2) gives 


(102-5) 5«(x) -/(*)= J r “ [/(* + 2u) - ;(a.) fP(2n tl)« ^^ 

—T —X DlU. Ve 

2 


If * U{x + 2u) 
X’,/—2w 


/(jg) . 2u 
sin u 



-|- Du du. 


Now the expression appearing in the bracket of the last integral 
is a continuous function of «, except, possibly, when « = 0. 
But 


lim ~ 

2u sin u 


2S\x), 


* Knopf, K., Theoiy and Apolicatioo of Io6nite Series, p. 356. 
Cabblaw, H. S., Fourier’s Series and Integrals, p' 207. 
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since 


lim ^ 
u->o sm u 


= 1 . 


Hence, if the value of the function 

p(u) = /(^ + ~ /(^) . 

^ ' 2u sin u 


is defined at tt = 0 by the equation 

F(0) ^ 2/'(x), 

then Fiu) is surely bounded. But the theorem of the preceding 
section states that for any integrable function <p(u) 

lim rV(u) sin nu du = 0, 
n-» • J<^ 

so that the integral in (102-6) approaches zero as n—> oo. 
Accordingly, 

lim (S„(x) = /(x). 

n-»« 

The foregoing proof can be extended to include the case of a 
function with a finite number of ordinary discontinuities if 
the function possesses a derivative at every point where it is 
continuous. 

103. Orthogonal Functions. A set of continuous functions 

(103-1) Wi(x), U2{x)y • • • , Unix), • • • , 

which do not vanish identically in the interval a ^ ^ 5, is 

said to be orthogonal with respect to the interval (a, h) if the 
functions Uiix) satisfy the relations 

(103-2) j*^Ui(x)uj(x) dx = 0, if i ^ j. 

For i = j, (103-2) becomes 

£luiix)]^ dx s c*, 

where cj certainly is not zero. 

If each of the orthogonal functions tti(x) be divided by c< 
there will be obtained a system of normal orthogonal functions, 
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Vi(x) = 


Uijx) 

Cl 


Vi(x) = 


Cj 



which are characterized by the property that 

(103-3) j‘%i{x)vj(x) dx = 0, if i j, 

= 1, if i = j. 

Consider a set of normal orthogonal functions Vi(x), and 
assume that an arbitrary function f(x) can be expanded in a 
series 


(103-4) f(x) = aiVi(x) -h aiVi(x) -f- • • * -h a„»„(a;) -f- • • • 


= '^o.Mx), 

t-1 

which can be integrated term by term. Multiplying both sides 
of (103-4) by Vj{x), and integrating term by term between the 
limits a and 6, 


fy(.x)vi{x) dx = '^ aij\{x)vi(x) dx, 

which, by virtue of (103-3), gives the formula 

(103-5) Qi = jy{x)vi(x) dx, (i = 1, 2, 3, * * • )• 

The numbers a* are known as the Fourier coefficients of the 
function/(x) associated with the system of normal and orthogonal 
functions 

vi{x), V2(x), • — , Vn{x), • • • . 

The set of functions 


1 cos X sin x cos 2x sin 2x cos nx sin nx 

— • • • , — —} — —) • • • 

V 2ir V V ^ 

is obviously a normal orthogonal set in the interval (—ir, t). 

Instead of approaching the subject of the expansion of arbitrary 
functions in a trigonometric series with the aid of the criterion 
of Sec. 100, one could begin by assuming that it is possible to 
expand the function /(x) in a series 
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(103-6) /(x) = ^ + 2 “1“ 

Jb-l 

which can be integrated term by term in the interval (—tt, tt). 
Multiplying both sides of (103-6) by cos mx, and integrating 
term by term with the aid of the formulas (101-3), gives 

1 T’" 

ak = ~J f{x) cos kx dXy (fc = 0, 1, 2, * * • ). 

Similarly, multiplying (103-6) by sin mx, and integrating the 
resulting series term-wise, furnishes 

= “ I /(^) sin kx dXy (fc = 1, 2, 3, • * • ). 

Thus, the hypothesis that the function /(x) can be expanded in 
a trigonometric series (103-6) that can be integrated term by 
term leads to the same values of the coefficients as those obtained 
earlier by an entirely different method. 

It is seen from the foregoing that the discussion of Secs. 100 
and 101 constitutes a very special case of the problem of repre¬ 
senting an arbitrary function /(x) by a series of orthogonal 
functions. 

^104. Expansion of Functions in Fourier Series. This section 
contains some illustrative examples of expansion of functions, 
satisf 3 dng the Dirichlet conditions in the interval (— tt, ir), in the 
series 


«0 


(104-1) 

^ 2 (on COS nx + b„ sin nx), 

n»l 

where the coefficients a* and 6„ are given by the formulas 

(104-2) 


fix) cos nx dx, 

— T 

and 

(104-3) 

11 

r»ir 

fix) sin nx dx. 

—w 
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Illustrative Example 1. Expand /(x) == x in Fourier series in 
the interval —ir ^ x ^ ir. Calculating the coefficients On and 
6n gives 


and 


an 






X cos nx dx = 0, 


sin nx dx = — cos nr. 
n 


Hence, 


X = 2[( —K cos ir) sin x + ( — H cos 2ir) sin 2x 

+ (““H cos 3 t) sin 3x + 


or 


] 


. sin 2x , sin 3x \ 

* = 2(^8in z - + -j- - ■ ■ ■ j. 

In this particular case only the sine terms remain. It may be 
noted that whenever the function/(x) is an odd function, that is, 
when/(—x) = —/(«), then an = 0, forn = 0, 1, 2, • • • , since, 
for such a function. 



cos nx dx 



cos nx dx. 


Similarly, if /(x) is an even function, that is, when/(—x) = /(x), 
then 6n = 0, forn = 1, 2, 3, • • • , since 


j^J(x) sinnxdx= sin nx dx, 

so that the function would be represented by a series of cosine 
terms. 

If in the foregoing illustration the first four terms be plotted by 
composition of 

y = 2 sin X, y = —sin 2x, y = % sin 3x, y = — sin 4x, 


the curve 


y — 2 sin X — sin 2x + % sin 3x — H sin 4x 

is obtained. It is represented on Fig. 83. As the number of 
terms is increased, the approximating curves approach y =» x as a 
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limit for all values of x, — < x < ir, but not for x = ±t. 

Since the series has period 2 t, it represents the discontinuous 



Fio. 83. 

function, shown in Fig. 84 by a series of parallel lines. It should 
be noted that each term of the series is continuous and the func¬ 



tion from which the series was derived is continuous, but the 
function represented by the series has finite discontinuities at 
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a; = ± (2k + l)ir. At such points the series converges to zero 
which is one-half the value of the sum of the right- and left-hand 
limits. 

Illustraiive Example 2. Develop f(x) in Fourier series in the 
interval (—ir, ir), if 


Now 


f(x) = 0, for 

= IT, for 


—T < a; < 0, 

0 < a; < TT. 


Uo = “1^ 0 • dx 4* v dx j = T, 

1 r " 

Un = “ I - 
irjo 

6. = if. si 
ttJo 


TT COS nx dx = 0, 


sin nx dx = -(1 — cos nv). 

n ' 


The series is then 




/ sin ; 

\ 1 


, sin 3x , sin 5x , 

I Q • E •” 


) 


The graph of f(x) from — ir to ir consists of the x-axis from 
-TT to 0, and the line AB from 0 to tt (see Fig. 85). There is a 



finite discontinuity for x = 0. For x = 0 the series reduces 

to which is equal to half the sum of lim/(0 — e) and lim/(0 + c). 
^ •->0 
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It may be observed from the series that every approximation 
curve will pass through the point ^0, The figure shows the 

first, second, third, and fourth approximation curves whose 
equations are 

7c ^ I rt • ^ I of • , sin 3x\ 

y = 2 ' y = 2 + ^ ^ 2 ^ “*-^ A 


^sin X 




as well as the graph of f(x). 


, sin 3a: , sin 5x) 
^ 3 “5“j 


At a: = ±ir the series reduces to and again every approxi¬ 
mation curve gives this same value for the ordinate at ± 7 r. 
This value is one half the sum of/(—ir+) and/(x—). 

Illustrative Example 3. Let f{x) be defined by the relations 


f{x) = -X, 
= Xy 


—X < a: < 0, 
0 < a: < x; 


then the Fourier coefficients for/(a:) are given by 




X 

= - 2 ’ 


if r® 

Six) coanxdx = - I —*■ coamdx- 
r rr\_J —*• 

_ 1 A L cosnx 1 1 

^ n» n*J 

if cos nx — ll 

“ i—J' 

if r® 

fix) ^nxdx = - I —w^nxdx- 
r XL J —» 


XCOSnxdx+ I xcosnxdx 


= - I —xsinnxda:4- \ xsinnxdxx 

Jo J 

1 X X T 1 

» - - — r cos nx-cos nx 

X n n n J 


i(l — 2 COS nx). 
n 
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Therefore, 



2 2 cos Zx 

-cos*-5j— 

*■ ir 3* 


2 cos 5* 
T 5* 


, o . sin 2* , 3 sin 3x sin 4* , 3 sin 5* 
+ *■"* 2- + —3-4- + —5- 


When a; = 0, the series reduces to 


T 

4 


^(1 + 1 + 1 

xVl* ^ 3* ^ 5* 






which must coincide with (see Fig. 86) 


Thus, 


Hence, 


/(0+) +/(0-) ^ _T 


-Z - + 1 + 1 + . . . \ = -Z. 

4 t\1* ^ 3* ^ 5* ^ / 2 


1 + 1 + 1+_^l!. 

Also for * = ±T, the series pyes 

—Z + -(— +1 + 1 + •••^= 0 , 

4 ^ tU* ^ 3* ^ 5* ^ / ’ 
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since 

/(-T+) +/(t-) _ 

2 “ 

This example suggests the use of Fourier series in evaluating 
sums of series of constants. 


PROBLEMS 


1. Show that 




cos nx 
n* ^ 


(—T ^ a? ^ t). 


n — l 


2, If 


then 


f(x) = —for 
= 0, for 


—T < a? < 0, 
0 < a? < x; 


Ef \ ^ 2"^ COS (2n — l)a; 

/W=4-;2j .(2n-l)* 


^2 


( —1)» sin nx 


n* 1 


3. If 


then 


/(«) = 0, for 

= sin ®, for 


—T ^ X ^ 0, 
0 ^ X ^ t; 



n-l 


cos 2nx 
4n* - 1 


1 . 

2 Bm X. 


4. If/(x) = c* in the interval (0, 2x), then 


€• 


c*' — l| 1 , cos nx 
[ 2 '^ +n* 

n — l 



S. Deduce from Prob. 1 that 



n—l 


T* 

12 * 
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cos ax 


sin ira ^ , 2 a sin ra 

Ta - n») 

n —1 


COS nx, 


if —T ^ ^ IT. 

7. Deduce from Prob. 6 that 


x\a ^ n* - ay 


n-l 

8. Deduce from the expansion of /(x) = x + in Fourier series in the 
interval ( —ir, ir) that 



n — l 


9. Expand x sin x and x cos x in Fourier series in the interval (0, 2 t). 

10. Find the Fourier series expansion for/(x), if 

/(x) = |) for -T < X < |> 

= 0, for ~ < X < T. 

106. Sine and Cosine Series. The Fourier expansion for /(x) 
in (—TT, it) has the form (104-1), in which the coefficients Un and hn 
are given by (104-2) and (104-3). As previously observed 
(Sec. 104), if /(x) is an even function, (104-1) reduces to a series 
containing only cosine terms; and if /(x) is an odd function, 
(104-1) reduces to a series containing only sine terms. Now 
suppose that it is desired that /(x) be expanded in a Fourier 
series which will be used for the interval 0 to x- only. In that 
case it is frequently convenient to obtain the expansion in terms 
of sines alone or in terms of cosines alone. For this purpose 
define 


Fix) s/(x) 

for 

0 < X < w, 

Fix) ^fi-x) 

for 

— T < X < 0, 


so that F{x) is an even function identical with /(x) in 0 < x < ir. 
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For an even function: 


-W-} 
fj 


F(x) sin nx dx 


F(x) sin nx dx + I F(x) sin nx dx 

r »/0 

—J' F(—x) sin (—nx)(—dx) + F(x) sin nx dx j 
F(x) sin nx dx + F(x) sin tix dx j = 0, 


=] 


and 


On 


-If: 


irjo 


F(x) cos nx dx 

J o 

F(x) cos nx dx + | F(x) cos nx dx 

r 

F(x) cos 7UE dx + I F(x) cos nx dx 
F(x) cos nx dx. 


w 


/; 

I ' 


Hence, in the expansion of F(x) in the interval — v < x < x only 
the cosine terms appear. Moreover, F(x) is identical with /(x) 
for 0 < X < X. Therefore,* 


(105-1) ^(x) = ^ -h Oi cos X -f- o* cos 2x -h • • • -f o« cos nx 

+ ’ ■ ' 

in the interval (0, x), where 


2 I * 

(105-2) o» = - I /(x) cos nx dx. 

xjo 

Similarly, if F{x) be defined so that 

F(x) = /(x) for 0 < X < X, 

and 


F{x) m — y(—*) for —X < X < 0, 

* If /(x) has a finite discontinuity at the point x ^ Xt, then the left-hand 
membw of (106-1) is defined to be li[/(xt-f-) -|- /(x»-)]. 
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then the a» all vanish and 


(105-3) /(*) 
where 


bi sin X + bt sin 2x+ • • • + sin nx 

+ 
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(106-4) bn = - \ f(x) sin nx dx. 

Thus fix) can be represented in the interval 0 < x < ir by either 
(105-1) or (105-3). Frequently one series is more desirable 
than the other. 



Example. As has been determined already (see Example 1, 
Sec. 104), the expansion for fix) = x in a sine series is 


X 


2^si 


21 sin X 


sin2x . sin3x 

O I O 



This series represents/(x) = x in the interval (—tt, ir). If one is 
interested in the values of the function in the interval (0, t), the 
same function can be expanded in a series of cosines. 

In fact, in the interval (0, ir), 


X 


r 4 /cos X . cos 3a: cos 5x 
2 ;\ 1 3^ 5^ 


since 





On « 


and 


xcosnxdx — “ 1]* 
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The sine series represents the odd function shown in Fig. 87 
and the cosine series the even function in Fig. 88. The two 
graphs are identical in the interval (0 , t). 


PROBLEMS 

1. Show that if c is a constant) then, in 0 <x <ir, 

4 / . . sin Zx , sin bx . \ 

+ —+ —+ ■■ J - 

2. Give sine and cosine developments of y = a; sin x in the interval 
(0, ir). 

3. Show that, in (0, ir), 



4. Prove that if Six) is any function of x, it can be expressed as the 
sum of an even function of x and an odd function of x. 

TT TT 

6. Show that if/(x) = x for 0 < x < and/(x) == tt — x for - < x <t, 
then 


2 / cos 


2x cos 6x cos lOx 
2 + 32 “1“ “52 + 


6. Show that 


/ . x\ '^icosnx .. 

log ^2 sin -0<»<T. 

n — l 

7. Find the expansion in the series of sines, if 

= ^(t - x), 5 ^ ^ 

8 . Expand/(x) — in the series of cosines in the interval (0, «■). 
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106. Extension of Interval of Expansion. The methods devel¬ 
oped up to this point restrict the interval in which f(x) can be 
expanded in a Fourier series to (“t, it). In many problems 
it is desirable to develop f(x) in a Fourier series which will be 
valid over a wider interval. In order to obtain an expansion 
which will hold for the interval {—I, Z), change the variable by 


replacing x by 
Fourier series in 2 , 


Then f(x) = 



can be developed in a 


(106-1) 



= ^ COS nz + sin nz. 


n —1 


n -■ 1 


in which 


and 



cos nz dz 


bn 



sin nz dz. 


The expression (106-1) will be valid for -t < 2 < t, but 
ttx 

2 = SO that (106-1) becomes 


(lOft-2) J{x) = ^ + ^ 

fi-1 n-1 

Also, 

1 f' yb\ , 1 r* // \ j 

a, = - I /I — 1 coanzdz = j J Sw cos -y- ax 
and 

bn = sin Tia d* = j J* ^/(*) sin dx. 

Example. Develop /(*) in Fourier series in the interval 
(—2, 2), if/(*) = Ofor —2 < x <0, andfix) = 1 for 0 < a? < 2. • 
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Here 


Oo 

a» 




0 • dx + 


cos 


X j , r*. j \ 1 

-OX+ I 1 • cos-7i-O® ) = — 
Jo 2 J m 


. nxx 

sm-TT 

mr 2 


= 0 , 


Therefore, 

/W > ^ + ;(« 


. riTX J 

sm dx 


) = —{1 - 
/ nr 


coa nr). 


rx . 1 . Zrx , 1 . 5rx , 

sm^ + 3Sin-^ + g8in-^ + 


> 


PROBLEMS 

1. The expansion of f(x) is desired for 0 < x <1. If F{x) = f(x) for 
0 <x < I and F(x) = —/(—a;) for —Z < x <0 (that is, F(x) is defined 
as an odd function), show that the expansion of F{x) and f(x) for 
0 < a; < {is 


2 . . nrx 

bnBm—} 


hn = f ^ 

If ^(x) » /(x) for 0 < a; < and (p{x) = f{—x) for —i x < 0 (that 
is, ^(x) is defined as an even function), show that the expansion of 
^(z) and fix) for 0 < a? < Hs 


do , nrx 

- + ^a.cos —, 


n-l 


where 


2 . rwra? . 

a„ = ~T" 


L Using the results of the preceding problem obtain the sine and 
cosine expansions of the following functions: 


(o) fix) = 1 in the interval (0, 2); 
(ft) /(*) « «in the interval (0, 1); 
(c) fix) » X* in the interval (0, 3). 
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3. Expand/(«) = cosira; in the interval ( — 1, 1), 

4. Expand 

fix) ^ H - X, if 0 <a?<Ji, 
if <x <1, 

in the series of sines. 

5. Find the expansion in the series of cosines, if 

fix) =0, if 0 < X < 1, 

= 1, if 1 < X < 2. 

6. Expand/(x) = |x| in the series of cosines in the interval (—1, 1). 

7. Show that the series 



sin 


2nwx 


n-l 


represents — x when 0 < x < /. 

8. Find the expansion in the series of cosines, if 

fix) = 1, when 0 < x < ir, 

= 0, when ir < x < 27 r. 

107, Complex Form of Fourier Series. The Fourier series 


(107-1) f(x) = ^ + 2 

n»l 

with 

a» = i f(i) COB ntdt, K — f(f) sin nt dt, 

can be written with the aid of the Euler formula* 

(107-2) e*“ = cos u + i sin u 

in an equivalent form, namely, 

»- + • 

(107-3) /(x) = 2 

n— — • 

where the coefficients Cn are defined by the equation 
(107-4) 


*S6eSec. 84. 
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The index of summation n in (107-3) runs through the set of all 
positive and negative integral values including zero. 

The equivalence of (107-3) and (107-1) can be established 
in the following manner. Substituting from (107-2) in (107-4) 
gives for n > 0 


1 T' 

c« = ^J /(<) (cos nf — f sin nf) 

= ^ J_/(<) cos n/ /(O si 


Biarddt 


_ 0>n • 

"■2 ^ 2 * 

A similar calculation forn < 0 gives 


do 

Co = 2 * 

Now (107-3) can be written in the form 

ce 00 

fix) = Co + Jc.c*"* + 

n-1 n-1 

Making use of the expressions for the c, just found gives 


/m-I+2 


dn I "f" ibn 




=^+ 2 ®' 


^inx ^ 


- 


Recalling that 


e<“ -f- e^“ = 2 cos w and e*“ — = 2i sin «, 


/(*) = + 2 (o« cos na -t- 6« sin nx), 

n-*l 

which establishes the identity of (107-3) with (107-1). 
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PROBLEM 

Show that the Fourier series in the interval (—1,1) can be written in 
the form 

/(*) = X * ’ 

n» — 80 

where 

1 tnW 

108. Differentiation and Integration of Fourier Series. It was 
proved in Sec. 101 that the Fourier coefficients of any integrable 
function defined in the interval (—tt, t) form a null sequence. 
A more precise bound for the magnitude of the Fourier coeffi¬ 
cients can be obtained if the function/(x) satisfies the conditions 
of Dirichlet in the interval (—tt, tt). The requirement that 
f{z) have only a finite number of maxima and minima is equiva¬ 
lent to saying that the interval x) can be divided into a 
finite number of subintervals in each of which the function is 
monotone. Consequently, 

(108-1) Un = M cos nx dx 

can be expressed as the sum of a finite number of integrals of the 
form 

(108-2) £f(x) COS nx dXy 

in each of which /(x) is a monotone function. 

The application of the second mean-value theorem for integrals 
(Sec. 37) to (108-2) gives* 

cos mdx ^ nxdx + /(6— cos nx dx 

_ /(a+)(sin — sin na) 

"" n 

/(b-)(sin nb — sin nQ 
n 

* The symbols f(a+) and /(6—) are used instead of /(o) and /(b) since 
the function may be discontinuous at the end points. 
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Now the numerators of these fractions are bounded, so that 

h 

fix) cos nx dx 

Since (108-1) is expressible as the sum of a finite number of 

integrals of the form (108-2), it is clear that On is of order* -• 

An entirely similar argument can be carried through for bn- 
This proves the following theorem: 

Theorem 1. The Fourier coefficients and bn of a function 
fulfilling the conditions of DirichUt in the irUerval (—ir, t) satisfy 
the inequalities 

loni < ^ and |6»| < 

71 n 

where M is a positive number independent of n. 

If the function /(a;), defined in the interval —ir ^ x ^ t, 
is periodic and has the derivative which satisfies the conditions 
of Dirichlet in the same interval, then the Fourier coeflBicients 

are of order ~ For, 




cos nx dx 


—IT 

= — /(x) sin nx —^ ( /'(x) sin nx dx 

nTT^^ J-,r nirj-/ 

1 

=- I /(^) sin nx dx. 

From Theorem 1 it follows that 

J^^/'(x) sin nx dx 


is of order so that 
n 


Kl < •;r.- 


1 M 

♦ Fin) is said to be of order —: if |F(n)| ^ -t» where M is independent 

n" n" 

of n. There are other definitions of the phrase (>J the order of; see, for 
example, Whittaker and Watson, Modem Analysis, p. 11. 
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A fflmilar argument proves that 


This result can be extended readily to establish 
Theorem 2. If the function f(x) is periodic and has A; — 1 derivor 
tives in the irUerval —x ^ z v, and is such that its kth derivative 
satisfies the conditions of Dirichlet in the same interval, then the 
Fowner coefficients for f{x) satisfy the inequalities 

l«»l < l*>«l ' ^ 


w 


n 


*+i' 


where M is a positive number independent of n. 

It should be noted that the requirement that the derivatives 
of the function f{x) exist implies the continuity of the function. 
Moreover, since f{x) is continuous in the interval 
the periodicity condition requires that*/(—x) = /(x). 

An important conclusion follows directly from Theorem 2. 
Consider a periodic function f{x) which is continuous in the 
interval (—x, x) and whose first derivative /'(x) satisfies the 
conditions of Dirichlet in the same interval. The Fourier 


1 


series for such a function has coefficients of order so that 


n* 


i/(*)i = 


^ (o« cos ni + hn sin nx) 

n —1 

•0 

^ + 2 l®n cos Tja; + hn sin nx\ 

n*l 

t0 

< Woi+2^’ 


n — l 


where Af is a positive number independent of n. 

This inequality states that the terms of the Fourier series 
are numerically less than the corresponding terms of a convergent 
series of positive constants. Hence, the series 

«9 

/(») “ ^+2^®" "*■*■*'* 
n-J 
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converges uniformly* in the interval (— t, it). Accordingly, 
the Fourier series for a function whose derivative satisfies the 
Dirichlet conditions can be integrated term by term. 

It is obvious that the differentiation of a trigonometric series 


(on cos nx + bn sin nz), 

n-l 

term by term, produces a trigonometric series whose coefiScients 
are of the order of nan and nfen, so that the differentiated series 
will converge less rapidly if at all. For example, the series 
resulting from term-by-term differentiation of the seriesf 
representing the function f{x) = x, (—t ^ a? ^ t), 

o\ o/ • sin 2x , sin 3x ^ \ 

(108-3) 2( sin X - ^ -1-g-- • • b 

is 


2(cos X — cos 2x -h cos 3a; — • • • )> 

which diverges for all values of x. 

On the other hand, term-by-term integration of the same 
series between the limits 0 and x gives the series 


Six) ^ 


/cos x|* 

-< 


cos 2a; 


^cos X 


2 * 
cos 2x 


. cos 3x 
-r 32 

cos 3x 


3* 


) 


} 


+ 2^1 2* + 3* 


Butt 



so that 






12' 


-S(*) 


e 




♦See Sec. 71. 
t See Example 1, Sec. 104. 
tSeeProb. 6, Sec. 104. 
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3 /^ 

which is precisely the Fourier series for in the interval 

— T ^ X IT.* 

Now despite the fact that the series (108-3) does not converge 
uniformly, the term-by-term integral of this series converges 
to the value of the integral of the function defined by (108-3). 
This is not an accident, and it is possible to prove that whenever 
f(x) is represented by a Fourier series, so that 


f(x) = ^ + 2 


n-l 


then 





n-l 


cos nx + bn sin nx) dx. 


In other words, the Fourier series representing /(x) can always 
be integrated term by term regardless of whether the given 
series converges uniformly or not.f 

However, great care must be exercised in differentiating the 
trigonometric series term by term. If /(x) is periodic and 
continuous in the interval and its derivative of the 

second order satisfies the Dirichlet conditions in the same 
interval, then the Fourier coefficients of /(x) will be of order 

~ The series obtained by differentiating the Fourier series 


for /(x) will have coefficients of order and consequently it 

Tt 

will converge uniformly. Under such circumstances the term- 
by-term differentiation is clearly legitimate. 

109. Fourier Integral. The theory developed in Sec. 106 
permits one to write the Fourier series of a function /(x) which is 
defined in the interval (—Z, 1), where I is finite but can be made 


* See Prob. 1, Sec. 104. 

t The proof of this remarkable fact will be found in a paper by E. W 
Hobson in the Journal of the London Mathematical Society^ vol. 2, p. 164,1027 
See also C. J. de la Vall4e Poussin, Cours d’analyse infinit4simale. vol. 2. 
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as large as desired. The limiting form of the series (106-2), 
when {is allowed to increase indefinitely, can be written in the 
form of an integral. It will be assumed here that the function 
/(«) satisfies the conditions of Dirichlet in any interval (—{, f), 
where I can be made as large as desired, and that the integral 

/_",!/(*) I dx 

converges. 

Since /(x) is assumed to satisfy the conditions of Dirichlet* 
in any interval {—1,1), it follows that 

«a 

(109-1) /(x) = ^ -I- ^ + &» sin 

II —1 

where 

<*« = cos hn- sia^dt. 

Substituting these values of the coefficients in (109-1) gives 

m 

(109-2) /(x) = Jif jit) dt + dt. 

n^l 

Since Jl"^l/(®)| dx is assumed to be convergent, 

la/-/® H a/-/®' ^ I- 

which obviously tends to zero as Z is allowed to increase indefi¬ 
nitely. 

Now, if the interval {—1,1) is made large enough, the quantity 

y which appeals in the integrands of the sum, can be made as 

small as desired. Therefore, the sum in (109-2) can be written 
as 

* If /(x) is not continuous at the point x •• x», then the left-hand member 
of (109-1) means W(x,+) +/(x,-)J. 
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(109-3) 


where 
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COS Aa(f — x) dt 

-f AoJ* ^(t) cos 2£ka(f — x) dt 

+. 

+i./; ^(t) cos nAa(t — x) dt 

+. 


]■ 


^ = r 
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This sum suggests the tiefinition of the definite integral of 
the function 

F(a) = cos ait - x) dt, 

in which the values of the function F(a) are calculated at the 
points 

T 2ir 3 t 
I’ l' l’ ' ’ ' ’ 

Now for large values of I 

cos ait — x) dt 

differs little from 


cos ait — *) dt, 

and it appears plausible that as I increases indefinitely the sum 
(109-3) will approach the limit 




fit) cos ait — x) dt. 


If such is the case, then (109-2) can be written as 
(109-4) Six) = s/.h: fit) cos ait — x) dt. 
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The foregoing discussion is heuristic and cannot be regarded 
as a rigorous proof that/(x) is capable of the integral representa¬ 
tion (109-4). However, the validity of the formula (109-4) 
can be established rigorously,* if the function f(x) satisfies the 
conditions enunciated above. The integral (109-4) bears the 
name of the Fourier irUegral. 

The formula (109-4) assumes a simpler form if f(x) is an even 
or an odd function. Thus, expanding the integrand of (109-4) 
gives 


(109-5) fix) 



cos at cos ax dt 



sin at sin ax dt. 


Now if fit) is an odd function, then the function fit) cos at will 
be also odd. Therefore, for an odd function fix), (109-5) 
reduces to 


fix) = I j; f(t) sin at sin ctx dt, 

since the first integral in (109-5) vanishes. Moreover, since 
f{t) sin at is an even function when f{t) is odd, the foregoing 
integral can be written as 

(109-6) f{x) = - I da\ f{t) sin at sin ax dt, 

Jo 

An entirely similar argument proves that if f(x) is an even func¬ 
tion, then 

(109-7) f{x) == - I da I f(t) cos at cos ax dt. 

^Jo Jo 

If f{x) is defined only in the interval (0, ir), then either (109-6) 
or (109-7) can be used, since the function f {x) may be thought 
to be defined in the interval (—t, 0 ) so as to make it either even 
or odd. However, it must be remembered that at the points of 
discontinuity the integrals in (109-6) and (109-7) converge to 
HI/(®o+) +/(xo--)], so that for a; = 0 the formula (109-6) 
will always give the value 0. 

♦ See Cabslaw, H. S. Fourier's Series and Integrals, p. 283. 
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PROBLEMS 

1. Set f(z) e~* in (109-6) and show that 


X 


a Bin ax . v 


if 


X > 0. 


2. Take 


/(x) = 1, if 

= 0, if 


0 ^ X < 1; 
X > 1 


and show, with the aid of (109-7), that 


X 


sin a cos ox , t 

if 

0 ^ X < 1; 

II 

if 

X = 1; 

= 0, 

if 

X > 1. 


3. Show, with the aid of (109-6) and (109-7), that 

X «*+/*’ 

r * cos ax 

Jo 


a Bin ax , t . _ ^ ^ 

^ da = if /3 > 0; 




Hint: Take /(x) = c 

4. Show that the Fourier integral can be written in the form 


/(») = 



dt. 


5. Consider the equations 

f(x) cos xtdx= F{t) 

and 

ip{x) sin xtdx— ^(0, 

where F{x) and $(x) are known functions and /(x) and <p(x) are the 
functions to be determined. The equations in which an unknown func¬ 
tion appears under the integral sign are called integral equations. Show 
with the aid of (109-6) and (109-7) that 


/(*) 



F{t) ooBxtdi 
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and 

^(«) « - I <l>(e) ^xtdi 

^Jo 

are the solutions of the given integral equations. Note particularly the 
remarkable form of these solutions. The integral equations of this 
problem are called the integral equatians of Fourier. 
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IMPLICIT FUNCTIONS 

110. A Simple Problem in Implicit Functions. The purpose of 
this and the next two sections is to present a simplified formal 
treatment of some of the important problems arising in the 
theory of implicit functions. These problems are investigated 
in some detail in the subsequent sections where sharper definitions 
and restrictions on the type of functions to be considered are 
supplied. 

A simple instance of an implicit functional relationship is 
that of the form 


(110-1) F(x, y) = 0, 


where, corresponding to a certain range of real values of x, 
the equation (110-1) defines a set of real values of y. In particu¬ 
lar, let {xo, yo) be a pair of values which satisfy (110-1), so that 

yo) = 0, 


and denote the totality of values of y, corresponding to a given 
range of values of x in the vicinity of x = xo, by 

(110-2) 

A question of practical importance will be considered next. 
Under what circumstances can one obtain a solution of (110-1) 
in terms of x in the neighborhood of (xo, yo)? If the function 
/(x) can be expanded in Taylor^s series about the point x = xo, 
then 


(110-3) y = f(x) = /(*j) -f- f'ixo){x - Xo) + 


+ 


nl 


(x - Xo)" + 


The coeffidents (n — 1,2, • • • ), appearing in (110-3) 

can be calculated from the known relationship (110-1) by the rule 
for differentiation of implicit functions. 

416 
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The difFerentiation of (110-1) with respect to x gives 

aF , ^ 0 

dx dy dx 

and, if Fy 7 ^ 0 at the point (xo, yo), then 

^ X_ yo) 

Fy(xo,j/o)‘ 

The value of /"(x) at x = xo can be calculated from the formula 


(110-4) 


dx Fy(x, y) 


which implies that Fy does not vanish in some neighborhood 
of the point (xo, yo)- Then 


(110-5) 


d*y _ 


Fy F„-|-F, 




Fyx + Fy 


and making use of (110-4) leads to the formula 


/■l 1 /» /!\ _ _ F^ XX 2F xFyFXV ~t~ F|Fyy 

dx* F» 

provided that the inversion of the order of differentiation is 
legitimate.* 

The formula (110-6) can be used to calculate the/"(xo) appear¬ 
ing in (110-3), since the values of the second partial derivatives 
at the point (xo, y^ can be calculated from the given function 
F(x, y). The value of /"'(x) at x = xo can be calculated with 
the aid of (110-6), and so on. In this manner one can construct 
the solution of (110-1) foj y in the neighborhood of the point 
(xo, Vo) iu the form (110-3). The essential feature of this dis¬ 
cussion is the requirement that Fy(x, y) does not vanish in the 
vicinity of the point (xo, Vo)* 

As an illustration of this approach to the problem of implicit 
functions consider the task of obtaining the solution of 

X* -b V* = 6, 


• See Sec. 81 . 
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which is valid in the vicinity of the point (2, 1). Noting that 


gives 

(110-7) 


2 » + 2»|-0 

^ _ _x 
dx y 


Differentiating again gives 

(UO^) g - 


I* + 


where the last step is obtained by substituting the expression 
for y' from (110-7). The expression for ^ can be calculated 
from (110-8); thus, 

cPy ^ 2yY + 2xy^ — + y^) 

cte* i/« 

_ ^x(x^ + y^) 

Obviously, the process of successive differentiation can be 
continued, in this case, as many times as desired. Substituting 
X = 2 and y = 1 in the formulas for the derivatives just obtained 
gives 

/'(2) = -2, /"(2) = ~5, /'"(2) = -30, 

so that the solution (110-3) becomes 

(110-9) y = 1 - 2(x - 2) - |j(x - 2)* - _ 2 )* 

+ • * * 

Of course, the solution of 


X* -f y* = 5, 

in the vicinity of the point (2, 1), could have been obtained by 
elementary algebra to give 


y = Vs - **, 


which upon expansion in the series of powers of x — 2 will yield 
the infinite series (110-9). 
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111. Generalization of the Simple Problem. The discussion of 
Sec. 110 may be generalized in two directions; 

(a) A greater number of variables may be introduced in the 
functional relationship (110-1); 

(b) The number of functions may be increased. 

As an instance of the generalization of the first type, consider 
a relationship of the form 

(111-1) F{x, y, z) = 0, 

and assume that corresponding to a certain region of values of x 
and y in the neighborhood of the point (xo, yo) the equation 
(111-1) defines the function z, say 

(111-2) z = fix, y). 

It is understood that (111-2) is such a solution of (111-1) that 
Fixo, Vo, Zo) s 0. 

Assuming, as in the case of the simple problem treated in 
Sec. 110, that fix, y) can be expressed in the form of Taylor’s 
series, namely, 

(111-3) z = fixo, yo) + (0)/^ - ®«) + ~ 

+ • • ■ , 

one can calculate the partial derivatives entering in (111-3) 
from (111-1). Thus, 


A j I j I j 

df- = 0 = ^dx-f--dy-|--<fe, 

and since x and y are assumed to be independent variables, it 
follows that 


(111-4) 




dF 

dx 

■ ' If 

dz 

-J3L. 

dF 

9y 

dF 

dz 


dz 


unless ^ vanishes in the neighborhood of (xo, Vo, Zo). 

The substitution of x — xo, y = yo, z = Zoin (111-4) yields the 
ooefileients of the linear terms appearing in (111-3). The 
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coeflScients of the higher powers of x — a:o and y — yo can be 
calculated successively with the aid of the formulas (111-4). 

dF 

Again, it should be noted that it is necessary to demand that ^ 

dz 

does not vanish in some neighborhood of the point (xo, yo, 2o), 
if the formulas (111-4) are to have a meaning. 

As an example of the generalization of the second type, con¬ 
sider a pair of equations 


(111-5) 


T(x, y, u, v) = 0, 
G(x, y, u, v) = 0, 


which connect four variables x, y, w, and v. Let it be assumed 
that there exists a set of four real numbers xo, yo, uo, vo such that 


and 


F(xo, yo, uo, Vo) = 0, 
G(xo, yo, uoy Vo) = 0. 


Further, suppose that the equations (111-5) can be solved in the 
vicinity of the point (xo, yo, Wo, vo) to yield 


( 111 - 6 ) 


(u = /(x, y), 

y)f 


which are so chosen that 


(111-7) 


(uo = /(xo, yo), 
( Vo = y(a:o, yo). 


If the functions /(x, y) and y(x, y) possess sufficiently good 
properties to admit of power-series expansion in the neighborhood 
of the point (xo, yo), then one can write 

« = /(*0, yo) + (|)^(* - Xo) + (|)^(y - yo) 

+ • • ' > 

» = g(xo, yo) + (^{x - xo) + - yo) 

+ • • • . 

The values f(xo, yo) and g(xo, yo) are known, since the left-hand 
members of (111-7) are prescribed in advance. The coefficients 
of the linear and higher powers of a: — *o and y — yo can be 


( 111 - 8 ) 
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determined by the differentiation of equations (111-5), where 
u and V are regarded as functions of the independent variables 
X and y. 

Thus, differentiating equations (111-5) with respect to x 
gives 

dx du dx dv dx ’ 

dx du dx dv dx 

Solving this system for ^ and ^ by Cramer's rule provides 

03 / 03 / 


(111-9) 


Now, if the denominator 
( 111 - 10 ) 


J 3 


does not vanish for (xo, yo, Uo, Vo), the values of 


dF 

aF 

du 

dv 


dG 

du 

dv 



dF 

dF 





dx 

dv 


du 

dx 


dG 

dG 


dG 

dG 

du __ 

dx 

dv 

dv _ 

du 

dx 

dx “ 

dF 


’ dx 

dF 

dF 


du 

dv 


du 

dv 



dG 



dG 


du 

dv 


du 

dv 


(S). ■ (I). (S). ■ (to). 

can be calculated from (111-9). Similarly, the differentiation of 

equations (111-5) with respect to y will yield formulas for 4^ 

oy 

and — which are analogous to (111-9) and which contain the 

same determinant J in the denominator. 

The coeflScients of higher powers of x — xo and y — yo in 
(111-8) can be calculated with the aid of the expressions for 
tlie first partial derivatives. It is obvious that the success of 
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this scheme depends on the nonvanishing of the determinant 
(111-10) in the neighborhood of the point (xo, yo, Uo, vo)- 
An entirely similar consideration of the set of three equations 

! F(x, y, z, u, V, w) = 0, 

G{x, y, z, u, V, w) = 0, 

H(x, y, z, u, V, w) = 0, 

shows that the determinant 


( 111 - 12 ) 



dF 

dF 

dF 

du 

dv 

dw 



dG 

du 

dv 

dw 

m 

m 

m 

du 

dv 

dw 


plays the same role in the problem of solving (111-11) for w, 
V, and w in terms of x, y, and z as (111-10) did in the simpler case. 

The determinants of the form (111-10) and (111-12) are called 
JacobianSf and they are fundamental to all of the investigations 
of this chapter. 

A particular form of the functional relationship (111-5) is of 
frequent occurrence in geometry. Let 


(111-13) 


X = <p(u, v), 
y = v), 


be regarded as the equations of transformation which establish a 
relationship between a set of points of some region of the xy-plane 
with the corresponding set of points in the up-plane. It will be 
assumed that there is a one-to-one correspondence of the points 
of the region in the a:y-plane with those of the «t>-plane. Let 
it be required to obtain from (111-13) the inverse transformation, 
namely, 


(111-14) 


(u = f(x, y), 

V = «f(a:, y). 


The equations (111-13) can be put in the form (111-5) by 
writing them as 

F(x, y, u, v) s <p{u, r) - a: = 0, 

Oix, y, u, v) = ») - 1 / = 0. 
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Hencei if the scheme outlined above is to be available for the 
calculation of the inverse transformation, it is necessary to 
demand the nonvanishing of the determinant 


(111-16) 


It is clear that a similar consideration applied to a set of n 
equations of transformation of the form 


dip 

dip 

du 

dv 

d\p 

drP 

du 

dv 


(111-16) 


'Ui = Uiixi, Z2, 
U 2 “ ^ 2 ( 3 ?!, X2j 


\Un = Un(Xij 3 : 2 , • • • , Xn)y 

will lead to a consideration of the determinant 


(111-17) 


dui 

dui 


dui 

dxi 

dx2 


dXn 

dU2 

dU2 


dU2 

dXi 

dX2 


dXn 

dUn 

dUn 


dUn 

dxi 

dX2 


dXn 


It is interesting to note that if the equations of the transformation 
(111-16) are linear, so that 

Ui = OiiXi + ai 2 a ;2 + • • • + OinXn, (i = 1, 2, • - • , n), 

then (111-17) is precisely the determinant of the coefficients 
of the x% namely. 


an 

aia . 

• • Uln 

U21 

U22 • 

. . . a 2 n 


ant • 

* • • Onn 
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and it is well known that in obtaining the solution for the vari¬ 
ables Xi in terms of the tti, it is necessary to demand the non¬ 
vanishing of the determinant A. 

112. Functional Dependence. Another important problem 
arising in the study of implicit functions is that of the functional 
relationship that may exist among a set of functions. As a 
simple example of such a circumstance, consider a pair of real 
functions 


( 112 - 1 ) 


(u = /{x, y), 
V == y), 


of the variables x and y, defined in some region R of the a:2/-plane. 
It will be supposed that the functions u and v, together with 
their first partial derivatives, are continuous in jR. Further, 
suppose that there exists a functional relationship between the 
functions u and v of the form 


(112-2) F(u, v) = 0, 

such that 

(112-3) y), g{x, y)] = 0. 

The identity sign in (112-3) means that the left-hand member of 
(112-2) annuls itself for all values of x and y in the region R 
when /(x, y) and gf(x, y) are substituted for u and v, respectively. 
Differentiating (112-2) with respect to x and y gives 

=0 

. \dudx'^ dv dx 

\du dy dv dy 


The equations (112-4) may be looked upon as a set of two homo^ 

OF BF BF BF 

geneous linear equations in — and — • Now — and ^ cannot 

both vanish identically in R, since this would imply that F(u, v) 
is independent of u and v. Consequently, if F is to be a function 
of « and t», then the system (112-4) must possess nonzero 

bf bf 

solutions for — and ^: hence, the determinant of the coefficients 
ou ov 

fdF ,dF , 
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— ^ 

, _ da? dx 

du 

dy dy 

must vanish for all values of x and y in the region R. These 

considerations can obviously be extended to cover the case of a 
set of n functions Xa, • • • , Xn) of n independent variables 

Xi, X2f • • • , Xn* 

It appears from this formal investigation that the vanishing 
of the Jacob.an is a necessary condition for the existence of a 
functional relationship among a set of n functions Ut(xi, a; 2 , • • • , 
Xn), and it will be shown rigorously in Sec. 115 that this condition 
is both necessary and sufficient. 

As a specific illustration of the foregoing consider the set of 
three functions 

{ w = X + 2/ + «, 

V = xy + 2/2 + X 2 , 

It; = X* + 2/^ + 

It is easily checked that 

f (w, v, !(;) s u® — 2t; — = 0. 

The Jacobian of (112-5), namely, 

1 y + z 2x 

1 X + 2 22/ s 0 

1 2/ + X 22 

as it should be. 

On the other hand, the relations 

u = X* — y\ 

V == 2xy, 

give 

2x 2y 

J = « 4(** + V*), 

—2y 2x 
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which obviously does not vanish identically in any region R, 
so that u and v cannot be connected by means of any analytic 
relationship of the form F(Uf v) = 0. 

113. Existence Theorem for Implicit Ftmctions. It is the 
purpose of this section to furnish a rigorous discussion of the 
problem which was treated formally in Sec. 110. Let F(x, p), 
regarded as a function of two independent variables x and p, 
be such that for x = xq and y = yo 


Fixof yo) = 0 . 

Consider a rectangular region (Fig. 89) bounded by the lines 


X == Xo ± h, 
y = yo ± k, 

and suppose that correspond¬ 
ing to every value of x in the 
interval (xq — h^Xo + h) there 
exists one, and only one, value 
of y lying in the interval 
(yo — kj yo + k) such that 



(113-1) F(z, y) = 0. 

Under these circumstances 


the equation (113-1) is said to define y as an implicit function 
of X, If this function be denoted by the symbol 


y = /(*), 

then 

Vo = /(*o), 

and the latter is called the solution of (113-1) for y in terms of 
X at the point (xo, po). 

The following existence theorem is of fundamental importance 
in all considerations of this chapter. 

Theorem 1. Let xo be any real value of x such that: 

(a) F(xoj y) ^ 0 has a real solution yoj that ts, 

F(xo, yo) = 0; 

(b) F(x, y)y regarded as a function of two independent variables 
X and p, is continuous and has continuous partial derivatives 
Fn(Xy y) and F^(Xy y) in some region R enclosing the point (xo, yo); 
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(c) Fy{xn, yo) ¥■ 0; 

iAen F(x, y) = 0 con be solved (theoretically) as y = f(x) in the 
vicinity of x = Xo in such a way that 

yo = f(xo). 


Moreover, the sohUion is unique and is such that y = f(x) has a 
cordinuous derivative in the vicinity of x — Xo which is given by the 
formula 


m = 


F*(x, y) 
Pv(x, y) 


Since F(x, y) is assumed to be continuous in some region 
containing the point (xo, yo), the function F(xo, y), obtained 
from F(x, y) by setting x = Xo, is a continuous* function of y. 
SF 

Furthermore, — 0 at (xo, yo), so that the function F(xo, y) 

ay 

is increasing in the vicinity of y = yo if F,(xo, yo) > 0, and is 
decreasing if Fy(xt,, yo) < 0. But F(xo, yo) = 0; hence, the 
function F(xo, y) must change sign at y = yo. For definiteness 
let Fy(xo, yo) >0; then there exists an interval (yo — 5, yo + 5) 
such that the function F(xo, y) is negative for all values of y 
such that 


yo — i ^ y < yo, 
and is positive whenever 

yo < y ^ yo + 5. 

Furthermore, F(x, yo — S) and F(x, yo + 5) are continuous 
functions of x, and for x = xo the function F(x, yo — S) is nega¬ 
tive. C!onsequently, there exists some interval (xo — S', Xo + 60 
about the point x = Xo such that F(x, yo — S) < 0 for all values 
of X in this interval. 

Similarly, F(xo, yo + 6) > 0, so that in a sufficiently small 
interval about the point x = Xo, F(x, yo + 6) will be positive. 
Let this interval be (xo — S", Xo + S"), and if 6i is the smaller 
of the two numbers S' and S", the functions F(x, yo — 6) and 
F(x, yo + 6) will have opposite signs for all values of x that are 
interior to the interval (xq — Si, xo + Si) (Fig. 90), 


See Sec. 22. 
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Let a? = be any value of x in the interval (xo — 5i, xo + 6i); 
then, since F(xi, yo — 6) and F(xi, yo + 6) are of opposite signs, 
there will be some value of y, say y = yi, where 

yo — 5 < < yo + 5, 

such that 

(113-2) F(xi, yi) = 0. 

The value of y satisfying (113-2) depends upon the choice of x, 
and, since for each value of x that is interior to (xo — 5i, xo + di) 



there is determined a value of y satisfying F(x, y) = 0, one can 
write 


y = fix). 

The continuity of y = fix) in the vicinity of a: = xo follows 
from the fact that for all values of x in the interval (xo — 6i, 
Xo + 5i) the equation 

Fix, y) = 0 

has a solution y = fix), for which y lies between yo — d and 

yo + 

At this stage of the proof one cannot assert that there is but 
one value of y corresponding to the choice x = Xi. In order 
to establish the uniqueness of the solution, the hypothesis of 
the continuity of Fy{x, y) in some region enclosing the point 
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(xo, ye) will be utilized. If Fy(x, y) is continuous in the vicinity 
of (xo, ye) and is different from zero at (xo, ye), then it will be 
different from zero at all points sufficiently near (xo, j/o). Now, 
if in the foregoing discussion S and di are chosen so small that 

F„(x, y) ^0 when [x — Xo| < 6i and \y — yol < 5, 

then the function 

F{x\, y), where Xo — < *i < Xo + 5i, 

will be either increasing or decreasing for all values of y in the 
interval (yo — 5, yo + 5). Under these circumstances F(xi, y) 
cannot vanish for more than one value of y. 

In order to establish the continuity of the derivative of 
y = /(x) in the vicinity of x = Xo, let (x + Ax, y + Ay) and 
(x, y) be a pair of solutions of F{x, y) = 0. Then 

F{x + Ax, y + Ay) — Fix, y) = 0 

and, obviously. 

Fix + Ax, y + Ay) — Fix + Ax, y) + Fix + Ax, y) 

- Fix, y) = 0. 

By hypothesis F»(x, y) and Fyix, y) are continuous functions 
in some region R about (xo, yo). Therefore, from the mean-value 
theorem,* it follows that 

LyFyix -b Ax, y + 01 Ay) -b AxF,(x + 02 Ax, y) = 0, 

where 0 < 0i < 1 and 0 < 02 < 1. Solving for ^ gives 

Ay _ Fxjx -b 02 Ax, y) 

Ax Fyix -b Ax, y -b 01 Ay) 

and, letting Ax —>• 0, one obtains 

^ Fyix, y)’ 

since Fyix, y) 0 for every point (x, y) in the region R. 

If the assumption of the continuity of F,(x, y) is abrogated, 
one cannot assert that the solution y = /(x) will possess a con- 

* See Sec. 20. 
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tinuous derivative in the vicinity of x = xo. However, the 
solution y = f{x) will be unique and continuous under the 
hypothesis that Fy{Xj y) is continuous in the neighborhood of 
(xo, yo) and is different from zero at the point (xo, yo). It is 
not difficult to demonstrate the existence of a unique solution 
on the hypotheses that Fy(xof yo) is different from zero and 
y) does not change sign in the vicinity of (xoy yo).* 

An argument in every respect similar to the foregoing permits 
one to generalize Theorem 1 to include the case of functions 
of more than two variables. Thus, one can enunciate the 
following theorem: 

Theorem 2. Let the function F{xiy X 2 , • • • , Xm, u) satisfy the 
following conditions: 

(а) F{x\y x^y • • • , Xfn, u) has a real solution u^ for Xi — Xi, 
X2^ xl • • • yXn, = x®,; 

(б) F{xiy X 2 , • • • y Xfn, u), regarded as a function of ttc m + 1 

independent variables Xi, Xj, • • • , Xm, Uy is continuous and has 
continuous partial derivatives • • • , F^^y Fu in some region 

of space enclosing the point (xJ, xj, • • • , x®, w®); 

(c) Fu{x\y X?, • • • , x®„ w®) 0. 

Then F{xiy X 2 , • • • , x^, w) = 0 can be solved in the vicinity of 
(^ 1 , • • • I a;®,) to yield 

U = /(Xi, X2, • • • , Xfn) 

in such a way that 

U® = f{x\y X5, • • • , X®,). 

The solution u = /(xi, X 2 , • • • , Xm) is unique and is continuous 
in the vicinity of the point (x®, xj, • • • , x®») together with its first 
partial derivatives, which are given by the formulae 


du __ 

Fnixi, Xt, • 

• • , a:m, «)^ 

dxi 

**, ' 

• * ,Xm,U) 

du _ 

F„{xi,x,, • 

' • ,Xm, u) 

dXi 

Fuixi, Xt, ' 


du _ 

F^(xi, Xt, • 

, Xfn, U) 

dXm 

F «(xi, Xs, 

, Xm, U) 


* See Hobson, E. W., Functions of a Real Variable, vol. 1, Secs. 316,316^ 
pp. 482-436. 
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114. Existence Theorem for Simultaneous Equations. 
Theorem. Let a system of n equations 

(114“1) Fi(Xiy Xif * ' * > ^mf Uif Uif “ * * / Un) = Oj 

(t = 1, 2, • • • , n), 

in m + n variables Xi, x*, • • • , Xm, Ui, have a real 

solution xj, xJi • • • ) ®Jii «i> «*»•••> wS) so that 

(114-2) Fiixl, xS, • • • , X®,, «?, ttS, • • • , wS) = 0, 

(t = 1, 2, • • • , n). 

If the functions 

Fi(xif Xif * • • > ^tnf * * * > 

regarded as functions of m + n independent variables, are con- 
tinuous and have continuous first partial derivatives in some region 
R of the m + n dimensional space enclosing the point P, whose 
coordinates are (x®, xj, • • • , xj», ul, ul, • • • , w®), and if the 
Jacobian 


j _ Fa, — • , Fn) _ 

d{Ui, W2, • • • , Un) 


is different from zero at the point P, then the set of equations (114-1) 
can be solved as 

(114-3) Ui = fi{xi, Xi, ■ ■ ■ , Xn,), (t = 1, 2, • • • , n), 
in the vicinity of the point P in such a way that 

W? = fi(A, * 1 , • • • , a:^), (i = 1, 2, • • • , n). 

Moreover, the set of solutions (114-3) is unique and the functions 
Ui are continuous together with their first partial derivatives in 
the neighborhood of the point (xj, *§,•••, xi). 

This theorem has been established in Theorem 2, Sec. 113, 
for the case when n — 1, in which the Jacobian reduces to F«,. 


dFi 

dFi 

dFi 

dui 

dU2 

du„ 

dFi 

dFt 

dFi 

dui 

dU2 

dUn 


dFn 

dF„ 

dui 

es 

dUn 
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It is natural to extend this proof to a greater number of functions 
by mathematical induction. Thus, if the correctness of the 
theorem can be established for n functions on the hypothesis 
that the theorem is true for n — 1 functions, then the truth of 
the theorem follows for n = 2, 3, 4, • • • , since the theorem 
is known to hold for n = 1. 

By hypothesis the determinant J does not vanish for the 
particular set of values (x?, • • • , a;®,, w?, uj, • • • , u^), 

so that all of its elements cannot be equal to zero. Let it be 
supposed that it is the partial derivative 

^ , 

dUnP 

appearing in J, that does not vanish.* Then it follows from 
Theorem 2, Sec. 113, that the equation 

(114-4) Fn(Xi, X2j • • • , Xfn, ^1, ^2, * * * , Un) = 0 

can be solved to yield 

(114-5) V>n ~ ¥^(Xiy Xzy * * * > Xm) * * * > l)) 

in such a way that 

wS = ip(xly 4, • • • , xly wj, wS, • • • , wLi). 

Substituting (114-5) in the first n — 1 equations of the set 
(114-1) gives 

(114-6) X2y * * * > Xm) ^1, ^^2, * * * > Wn—l) ~ 0, 

(z = 1, 2, • • • , n — 1), 

where 

(114-7) ^<(Xi, a:2, • • • , Xm, Ui, ^2, • • • , Wn-l) 

s Fi{xi, X2) • • • , Xm) Wi, W2, • • • , Un-l, (p). 

Equations (114-5) and (114-6) are equivalent to the system 
(114-1). Now if the n — 1 equations (114-6) can be solved for 
Uiy U 2 ) • • • y Un-i in terms of Xi, X 2 , • • • , Xm, there will be 
obtained a set of n — 1 functions 

(114-8) Ui = fi(xi, xi, • • • , Xm), (z = 1, 2, • • • , n - 1). 

* By reordering the functions (114-1), if necessary, it is always possible 
to achieve this. 
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Substituting from (114-8) in (114-5) gives 

(114-9) tt» = Sn{Xi, X2, • • • , *»,). 

The set of n functions (114-8) and (114-9) is the desired set 
(114-3). But the set of n — 1 equations (114-6) is of the type 
(114-1), and if it is assumed that the theorem is valid forn — 1 
functions, then Eqs. (114-6) can be solved for ui, «*,•••, «»_i 
in terms of *i, x*, • • • , x„, provided that 

A = 3(^1, 4»2, • • • , »n-l) , ^ 

d(ui, Ut, • • • , M«_i) 

for (xj, xS, • • • , X®,, u\, «?,•••, «X_i). 

In order to show that A does not vanish it is desirable to write 
it out explicitly. From (114-7) it follows that 


^ ^ A. ^ if., 

dUi dUj dUn duy 

so that 


(i,i = 1,2, • • • ,n-l). 


dFi 

^ . 

d^ 

dF 1 

aFi ^ 

dip 

dFi 

, dF 1 

dip 

dui 

du^ 

dui 

dUi 

^ dUn ‘ 

dut 

SUn-l 


dUn-.i 

dF 1 

dF 3 

* 

dip 

dFi 

1 . 

dip 

dFz 

dF i 

dp 

dui 


dui 

dUi 


dut 

9Uk-i 

dUn * 

dUn^l 

dFn-l 

. dFn-l 

dip 

dF n-i 

d^n-l 

dip 



dp 

dUi 

dUn 

dui 

dlii 

dUn 

dut 

dUn-1 

dUn 

dUn-l 


Since each element of this determinant is made up of the sum of 
two terms, A can be expressed as the sum of 2“~‘ determinants.* 
Some of these 2"~^ determinants will contain two columns that 
are proportional, so that they will vanish, and the remaining 
ones give 

(114-10) A = ' ‘ ' »^»-») ^ .if 9{Fi,Ft, ' • • ,Fn-i) 

' ^ d(.Ul, tt2, • • • , tt,_l) dUl diUn, «2, • • • , Un-l) 

^ . . . ^ HFi,Fa, • • • ,F»-i) 

dit»-id(ui, Uz, • ' ■ , «,_2, «»)* 

* It will be recalled that 


Oi + h\ Cl di 
-l- ht Ct dt 
<»• ht ci di 


tti Cl di 
o* Cl di 
oa Cl dt 


+ 


bi Cl di 
Cl dt . 
6a ca dt 
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d<p dtp dip 

dui dU2 * dUn-l 

which appear in (114-10), can be obtained as follows. Recalling 
(114-6) and applying the rule for the differentiation of implicit 
functions to (114-4), one finds 


dUi dUn dUi 

Hence, 


dip 

dUi 


(t = 1, 2, • • • , n - 1). 


duj 

^ ■ 

dM, 


On substituting these expressions for the in (114-10) and 

dF 

multiplying both sides of the resulting equation by there 
results 


** = d(F h Ftj • * * i F n~l) ^ dFn 

dUn d(Uu W2, • • • , Un-l) dUn 

—. d(F I, Fjf • • • f F n-l) dFn , 

d(Wn, W2, • • • , Un-l) dUi 

_ a(Fl, Fg, ■ ■ * yFr^i) dFn 

a(Wi, W2, • • • , Wn~2, Un) dUn^l 

A little reflection shows that the right-hand member of this 
equation is precisely the expansion of the Jacobian J in terms 
of the elements of the last row of J. Hence, 


A 


dUn 


which, by hypothesis, does not vanish at the point P. 

116. Functional Dependence. 

Theorein. Lelti< = /<(xi,X2, • • • ,x0> (^=1)2, • • • ,n), 

he a set of n functions of n independent variables Xi, Xi, * • • , Xn. 
The functions ft together with their first partial derivatives are 
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assumed to he cordinuous in some region R enclosing the poirU 
(xi, • • • > ^ necessary and sufficient condition thoJt 

there exist among these functions a relation 

F{ui, W2, • • • , Un) = 0, 

which does not contain the variables Xi, X 2 , • • • , Xn explicitly, 
is that 


J s= U^f * * * > ^n) ^ Q 

d{xi, X2, • • • , Xn) 

for all values of the variables Xi, X 2 , • • • , Xn in the region R, 

In order to avoid complications in writing, the theorem will 
be established for the case of three functions 


! w = fiix, y, 2), 

» = y, 2 ), 

w == Mx, y, 2 ), 


since the discussion of this case possesses all features of the 
more general circumstance. 

To demonstrate the necessity of the condition of the theorem, 
assume that the Jacobian 


(115-2) 


j ^ d{u, V, w) 
d{x, y, 2 ) 


9fi 

dh 

dfi 

dx 

dy 

dz 



dft 

dx 

dy 

dz 



df. 

dx 

dy 

dz 


does not vanish at some point (xt, yo, zo) of the region R. Denote 
the values of u, v, and w, calculated from (115-1) by setting 
X = xo, y = yo, z = Zo, by Wo, Vo, and Wo. It follows from the 
theorem of Sec. 114 that one can solve (115-1) to give 

* = Vi(v, V, w), 
y = vt{u, V, w), 
z = V, w), 


where the solution is valid for an arbitrary choice of u, v, and w 
belonging to some region about the point (uo, Vo, Wo). Since the 
choice of the numbers u,v,wia arbitrary, there can be no relation 
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F{u, v,w)=0 

in the region R under consideration. 

To prove the sufficiency, consider again the set of functions 
(115-1) and assume that (115-2) vanishes identically in the 
region R. Consider first the case where at least one of the 
minors of J does not vanish identically, and assume that such a 
one is 



dfy 

dx 




dx 

dy 


Since A 0 in /2, one can solve the first two of Eqs. (115-1) for 
X and y to yield 


(115-3) f - "!' 

(2/ = <P 2 {u, V, z). 

Substituting these values in the third of Eqs. (115-1) gives 
(115-4) w = ip2, z) = F(m, V, z). 


Now if the right-hand member of (115-4) contains no 2 , 
then It? is a function of the variables u and v and this will establish 
the sufficiency of the condition for this case. It will be shown 
next that F(w, v, z) indeed is independent of 2 , since it will be 
proved that 



Calculating this partial derivative from (115-4) furnishes 


(115-5) 


dF ^ djj dip i , dip2 , d/a 
dz dx dz dy dz dz 


But, since (116-3) represents the solution of the first two of 
Eqs. (115-1), the substitution of (115-3) in the first two of Eqs. 
(116-1) yields the identities 


<P2f 

Hfh «) * 
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It is, therefore, evident that vt, z) and <pt, z) are 

independent of z, so that 


(116-6) 


^fl I ^ 9^2 I ^ 

dx dz dy dz^ dz ’ 
3/2 1 3/2 d<P 2 I ^2 _ Q 

I dx dz dy dz dz 


Adding to the last column of the determinant J the product 

of the first column by and the product of the second column 
dz 

by gives the determinant 


J = 


dfi dfi dfidipi , dfid(p2 , dfi 

dx dy dx dz dy dz dz 

^ ^ ^ ^ ^ ^ 

dx dy dx dz dy dz dz ^ 

dfz dfs df 8 , df 3 d<p2 , dfz 

dx dy dx dz dy dz 


which, upon noting (115-5) and (115-6), reduces to 



By hypothesis / = 0 and A ^ 0, so that = 0. 

oz 

It remains to consider the case where every minor of second 
order of the determinant J vanishes but where at least one of 
the elements of J does not vanish identically in R, Suppose, 
for example, that 


dx 


^ 0 . 


Then one can solve the first of Eqs. (115-1) for x in terms of y 
and z, so that 

» = y, «)• 

Substituting this value of x in the last two of Eqs. (115-1) gives 

^ y, z) = F(w, y, z), 

^ * M<Pi, Vi z) e G{u, y, z)y 
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and it remains to show that F and 0 do not contain y and z, 
in which event both v and w are functions of u. It will be proved 
next that such is the case. 

Now, 


dF _ ^ dipt , 6 / 2 ^ 
dy dx dy dy* 

and from the first of Eqs. (115-1) it follows that 


dfi d<pi . ^ Q 

dx dy dy 


From these equations, and from the fact that every minor of J of 
order 2 vanishes, it follows that 



It can be verified in a similar way that 




and 


dG 

dz 


- 0 , 


and hence, both v and w are functions of u. 

The remaining case in which every partial derivative vanishes 
identically is trivial, because in this event the functions tx, v, 
and w reduce to mere constants. 

The extension of this proof to any number of functions is 
obvious. It may be remarked that, if the Jacobian of the n 
functions 


Ui = /i(xi, Xi, - , Xn), (t = 1, 2, • • • , n), 

is such that every minor of order greater than r vanishes iden¬ 
tically while at least one minor of order r does not vanish, 
then there will be exactly n — r independent functional relations 
connecting the variables. 

Example. Let 


u *= * + 2y + *, 

» = ® — 2y + 2 , 

to ■= X* + 2x2 — 4y* + 2 * 
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1 2 1 


J = 


1 


-2 1 


== 0 , 


\2ix + z) -Sy 2(x + z)\ 

so that the functions are dependent. Furthermore, since there 
exists a nonvanishing minor of second order, there is only one 
independent relation. In fact it is ti? = uv. 

116. Properties of Jacobians. Let there be a set of n functions 
Fi, F 2 , • • • , Fn of n variables wi, W 2 , * • • , Uny and suppose 
that the variables Ui are not independent variables but are 
functions of some other set of variables Xi, x^, • • • , Xn- Then 
it is easy to establish the following interesting formula: 


( 116 - 1 ) 


^(Fi, Fty 
d(Xu X2y 


,Fn) 

f ^n) 


d{FIt Fit • • • > Fn) U 2 , ‘ , Un ) 

d(Uu W2, • • • , Un) d(Xi, Xiy • • • , Xn) 


The result (116-1) follows upon multiplying the two deter¬ 
minants in the right-hand member according to the rule for 
the multiplication of determinants.* Thus, 


dFi 

dFi 

dFi 


dui 

dUi 

dui 

dui 

dUi 

du„ 


m 


dXn 

dFi 

dFi 

dFi 




dU2 

dUi 

dUi 

dUn 


dxi 

dX2 

dXn 





dUn 

dUn 

dUn 

dUi 

du% 

3M»j 


dxi 

dXt 

dXn 


♦ Note that if the n-rowed determinant |o,/|, in which an is the element in 
the tth row and the jth column, is multiplied by the n-rowed determinant 

n 

I 

\bn\y there results |a»i| * |&j/| 
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gives the determinant whose element in the ith row and the jth 
column is 

dFj dui . dFi du2 • . . . i 

dUi dXj dU2 dXj dUn dXj 

dF ’ 

The latter is recognized as the formula for —*• For n = 1, 

the formula (116-1) reduces to the simple formula for the deriva¬ 
tive of a composite function, namely, 

dF dF du 
dx du dx 


Another interesting property of Jacobians is worth noting. 
Consider a transformation 


(116-2) Ui — ^2t ' * * > ^»)> (l * * ’ ) ^)? 

and denote its inverse by 

(116-3) Xi = Uj, • • • , Un). 

The Jacobians of (116-2) and (116-3) are 

J = 3(Mi, Uj, • • ■ , Mn) J _ d(xi, Xt, ■ ■ ■ , Jn) 

‘ d{xi, a:*, • • • , Xn) * d{ui, Ut, ■ • ■ , m»)’ 

Then, 

J .J _ ^(mi» » Mn) . 3(a;i, Xj, ■ ■ ■ , Xn) ^ 

' * d(xi, *2, ' • ’ , Xn) diui, Ui, ■ ■ ■ , Un) 


which, by the formula (116-1), is equal to 


d(Ul, Uj, ■ • ■ , Un) ^ J 
d(Ui, U2, • • • , Un) 

Hence, the Jacobians of the direct and the inverse transforma¬ 
tions are reciprocals of one another. 


PROBLEMS 

1. If 

u =» «(x, y, «), 

V *• «»(*, y, *). 

to = w(x, y, a), 
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assume that ^ 0, so that one can solve the last two equations for 

diy, 2) 

y and 2 . Substitute these solutions in the first equation, and show that 

du _ d(u, V, w) _ d(y, z) 
dx d(x, y, z) d(v, w) 

2. Let 

X = x(u, v), 

y “ y{«, v), 

z = z(u, v), 

be the parametric equations of a surface from which u and v can be 
eliminated to give z = F{x^ y). Show that 

^ ^ y) 

dx d(u, v) ‘ d(u, v) 

3. The transformation of inversion in space is given by 

_ x _ y _ 2 

“ *» + j/* + 2»’ " + 2»’ aj» + y* +2»‘ 

Does it possess an inverse? Verify that the product of the Jacobians 
of the direct and the inverse transformations is unity. 
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Beta function, 376 
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Cauchy’s theorem, 53 
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91 
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Circular functions, 308 
Closed curve, area of, 178 
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Conditionally convergent series, 236 
Conservative systems, 204 
Continuity, 31, 35, 39, 58, 256, 276 
equation of, 206 
piece-wise, 34 
uniform, 37, 38, 60 
Convergence, 11 

absolute, 236, 240, 263, 268, 337, 
341, 344 
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tests for, 341, 349, 367 
interval of, 248, 267, 269 
radius of, 269 
of series, 209, 247 
tests for, 215, 225, 237, 262 
uniform, 247, 263, 264, 355, 367, 
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Coordinate surfaces, 155 
Coordinates, curvilinear, 148 
cylindrical, 157 
polar, 148, 152, 157 
spherical, 157 
Curve, simple, 179 
Curvilinear coordinates, 148 
Cut, 2 

Qylindrical coordinates, 157 
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D’Alembert’s ratio test, 217 
Darboux theorem, 108 
Dedekind, 2, 3 
Definite integrals, 09-129 
applications of, 126 
change of variables in, 124 
differentiation under sign of, 121 
evaluation of, 110, 118, 123, 144, 
178, 309 

mean-value theorems on, 113 
Density, property of, 1 
Dependence, functional, 423, 433 
Derivatives, 41, 47 
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directional, 76, 86, 87 
of higher order, 87 
of implicit functions, 68, 71, 89, 
426 

of integrals, 119, 121 
normal, 78, 86, 87 
partial, 62 
of series, 261, 405 
Differentials, 43 
exact, 191, 199 

{See also Total differential) 
of higher order, 47 
total, 64 

Differentiation, of composite func¬ 
tions, 45, 67, 71, 439 
of implicit functions, 68, 71 
(See also Implicit functions) 
under integral sign, 121, 353, 367, 
371 

inversion of the order, 87 
of series, 261, 405 
Direction angles, 80 
Direction components, 80 
Direction cosines, 81, 162 
Directional derivative, 76, 86 
{See also Gradient) 

Dirichlet’s conditions, 384, 385 
Dirichlet’s integral, 387, 362 
Discontinuities, 34, 392 
Divergence theorem, 167 


Double integrals, 130 
improper, 365 
Double series, 246 
convergence of, 247 

E 

e, base of natural logarithms, 28 
Ellipse, length of, 314 
Elliptic integrals, 117, 129, 312, 313, 
352 

Errors, approximate, 66 
relative, 66 
Euler’s formulas, 306 
Euler’s theorem, 75 
Evaluation of integrals, 110, 118, 
123, 131, 144, 178, 310, 357 
Even function, 391 
Exact differentials, 191, 199 
Existence theorem, for implicit func¬ 
tions, 425 

for simultaneous equations, 430 
Expansion, in Maclaurin’s series, 298 
in power series, 290, 291, 298 
in series of orthogonal functions, 
389 

in Taylor’s series, 298 
in trigonometric series, 389 
{See also Fourier series) 
Extended law of the mean, 291 
Extremal values, 327, 332 

F 

Factorial, generalization of {see 
Gamma functions) 

Fermat’s theorem, 49 
Fluid motion, 204 

Force of attraction, 172, 202, 369, 
372 

Fourier coefficients, 380, 389 
Fourier integral, 409, 413 
equation, 413 
Fourier series, 362-414 
complex form of, 403, 405 
differentiation of, 405 
expansion in, 390 
integration of, 405, 400 
uniform convergence of, 408 
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Fresnel’s integrals, 365 
Function, 22, 58, 321 
bounds of, 106 
composite, 45, 47, 439 
continuity of, 31, 35, 39, 59, 392 
differentiable, 43 
even, 391 
homogeneous, 75 
implicit, 68, 415-440 
integrable, 109, 110, 335n. 
jump in, 34 
multiple-valued, 22 
normal, 388 
odd, 391 
orthogonal, 388 
periodic, 379n. 
piece-wise continuous, 34 
sectionally continuous, 34 
single-valued, 22 
uniformly continuous, 38 
Functional dependence, 423, 433 
Functional determinant, 153, 157, 
167, 200, 421, 438 

Fundamental theorem of integral 
calculus, 110, 118, 120 

G 

Gamma functions, 372 
Gauss’s test for series, 230 
Gauss’s theorem, 169n. 

Geometric series, 214 
Gradient, 78 

Gravitational potential (see Poten« 
tial) 

Gravity, center of, 137, 159, 165 
Green’s theorem, 167, 170, 172, 181 

H 

Helix, 85, 86 

Homogeneous functions, 75 
Hyperbolic functions, 306 
Hyperbolic paraboloid, 325 

I 

Implicit functions, 68, 415-440 
differentiation of, 71, 416 
existence theorem on, 425 
higher derivatives of, 89 


Improper integrals, 335-377 
multiple, 365 
Indefinite integrals, 119 
Indeterminate forms, 54 
Induction, mathematical, 9, 431 
Infinite integrals, 335, 347 
tests for convergence of, 341, 349, 
367 

(iSfec also -Improper integrals) 
Infinite series, 209-266 
absolute convergence of, 236, 240, 
263, 268 

addition of, 212, 240, 281 
alternating, 234 
of arbitrary terms, 233 
•conditional convergence of, 236 
,convergence of, 209, 233, 236 
differentiation of, 261 
division of, 285 
double, 246 
expansion in, 298, 383 
of functions, 247, 275 
geometric, 214 
integration of, 258, 309 
multiplication of, 242, 281 
of orthogonal functions, 389 
of positive terms, 233 
of power functions, 267-334 
algebra, 280 
applications, 291-334 
calculations with, 285 
expansion in, 291 
integration, 309 
reversion, 289 
tests for convergence, 269 
uniqueness theorem on, 279 
remainder in, 234 
sum of, 209, 395 

t^ts for convergence, 215, 225 
237, 262, 269 

.uniform convergence of, 247, 252, 
275 

(See also Fourier series) 
Infinitesimal, 64n. 

Infinity, 16 

Integrable function, 109, 335n, 
Integral equation, 413 
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Integral test for series, 225 
Integrals, applications of, 126, 199 
change of variables in, 124, 147, 
155, 199 

containing parameters, 121, 353 
of Dirichlet, 387, 362 
definite, 99, 101 
differentiation of, 121, 353 
divergent, 335 

elliptic, 117, 129, 312, 313, 352 
evaluation of, 110, 118, 123, 131, 
144, 178, 310, 357 
of Fourier, 409, 413 
improper, or infinite, 335, 365 
(iSee also Improper integrals) 
indefinite, 119 
integration under sign, 353 
line, 174 

multiple, 130, 139, 142 
Riemannian, 104 
surface, 161, 196 
tests for convergence, 341 
transformation of (see Green's 
theorem; Stokes's theorem) 
uniform convergence of, 355, 367 
Integration, of Fourier series, 405 
under integral sign, 353 
by parts, 353 , 
region of, 131 
in series, 309 
of series, 258, 309 

Interchange of order of differentia¬ 
tion, 87 

Intervals, Abel's theorem on, 268 
of convergence, 248, 267, 269 
extension of, 401 
open and closed, 22 
Inverse transformations, 421 
Inversion transformation, 440 
Iterated integrals, 136 

J 

Jacobians, 150, 153, 157, 167, 200, 
421 

properties of, 438 
Jump in function, 34 


K 

Kummer's test, 228 
L 

Lagrange's multipliers, 329, 331 
Lagrangian form of remainder, 292 
Laplace's equation, 208, 372 
Law of the mean, 291 

(See also Mean-value theorem) 
Leibnitz’s theorem on series, 234 
Lemniscate, 128 
Length of curve, 127 
L'Hospital's rule, 54 
liapunoff. A., 383 
Limiting points, 17 
Limits, 6, 16, 58 
existence of, 10 
of functions, 23 
iterated, 61 

left- and right-hand, 24 
repeated, 61 
theorems on, 26 
upper and lower, 16, 18 
Line integrals, 174-208 
applications of, 171, 199 
properties of, 185, 198 
in space, 195 

transformation of, 181, 196 
Logarithm, base of, 10, 28, 31 
Logarithmic spiral, 128 
Lower bound, 22, 23, 106 

M 

Maclaurin’s formula, 295, 318, 320 
Maclaurin's series, 290 
Maxima and minima, 315, 321, 327, 
332 

Mean-value theorem, 51 

(See also Law of the mean) 
Mean-value theorems for integrals, 
113, 115, 131 
Mertens, F., 244 

Minima (see Maxima and minima) 
Minimax, 326 

Moment of inertia, 138, 145, 151, 
160,166 
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Monotonicity, 14, 15 
Multiple integrals, 130, 139, 142 
improper, 365 

Multiplication of series, 244 
Multiply connected regions, 184,192 

N 

Neighborhood, 8 

Newton’s law of attraction, 172, 202 
Newtonian potential, 172, 203, 370 
Normal derivative, 78, 86, 87 
Normal line, 80 

Normal orthogonal functions, 388 
Number system, 2 
Numbers, 1 
complex, 3 
rational, 1 
real, 2 

O 

Odd function, 391 
Order of, 406 
Ordering, 1 

Orthogonal functions, 388 
Ostrogradsky’s theorem, 169n. 

P 

Parameter, integrals containing, 121 
Partial derivatives, 62 
Partial sums, 209, 248 
Partition, 2 

Periodic function, 379n. 

Plane, tangent, 80 
Points of condensation, 17 
Polar coordinates, 148, 152, 157 
Potential, 172, 203, 206, 370 
Power series, 267-290 
applications of, 291-334 
Primitive, 119 

Principal part of increment, 64 
Probability integral, 357 

Q 

Quotient of power series, 282 


R 

Raabe’s test, 230n., 233, 303n. 
Radius of convergence, 269 
Ratio test, 217, 220, 237 
Rearrangement of series, 240 
Regions, simply and multiply con¬ 
nected, 184, 192, 196 
Remainder, 234 
in Taylor’s series, 292, 293 
Riemann integral, 99 
upper and lower, 108 
Riemann zeta-function, 364, 365 
Rolle’s theorem, 50 
Root test, 216, 220, 237 

S 

Schwarz’s theorem, 87 
Sequence's, 3 
bounded, 5 
convergent, 6, 14 
divergent, 16 
limiting points of, 17 
limits of, 6 
monotone, 14 
null, 5 

Series (sec Fourier scries; Infinite 
series) 

Simply connected regions, 184, 196 
Simultaneous equations, existence 
theorem for, 430 
Sine and cosine series, 397 
Solid angle, 171 
Space curve, 83 

equation of tangent to, 85 
length of, 86 

Spherical coordinates, 157 
Spiral, logarithmic, 128 
Stokes’s theorem, 196 
Stream function, 206 
Summation of series, 395 
Surface integrals, 161, 196 
Surface of revolution, 128 

T 

Tangent line, 70 
Tangent plane, 80 
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Taylor’s formula, 292, 293, 317 
applications of, 298, 322 
Taylor’s series, 296 
Tests, for integrals, 341, 349, 367 
for series, 215, 225, 237, 262, 264 
Total differential, 64 

{See also Exact differential) 
Transformation, of coordinates, 153 
of integrab, 167, 170, 172, 181, 
196 

of inversion, 440 

Trigonometric series {see Fourier 
series) 

Triple integrals, 142 
improper, 367 

U 

Undetermined multipliers, 328 
Uniform continuity, 37, 60 
Uniform convergence, of integrals, 
355, 367 

of series, 247, 262, 264, 408 


Upper bound, 23 
of a function, 106 

V 

Velocity potential, 206 
Vicinity, 8 

Volume, element of> 156, 158, 159 
of revolution, 128, 143, 155 

W 

Wallis’s formula, 311 
Weierstrass test, for integrals, 355 
for series, 262 

Work, as a line integral, 201 

Y 

Young’s theorem, 89n. 

Z 

Zeta-function, 364, 365 




